-- Logs begin at Wed 2022-10-12 04:11:05 UTC, end at Wed 2022-10-12 05:05:21 UTC. -- Oct 12 04:35:44.994131 dv-cinder-861032-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 04:35:45 2022] *** Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: nodename: dv-cinder-861032-1-smb Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: machine: x86_64 Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: clock source: unix Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: pcre jit disabled Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: detected number of CPU cores: 4 Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: current working directory: / Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: detected binary path: /usr/bin/uwsgi-core Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: your processes number limit is 47680 Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: your memory page size is 4096 bytes Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: detected max file descriptor number: 2048 Oct 12 04:35:45.004957 dv-cinder-861032-1-smb devstack@keystone.service[93078]: lock engine: pthread robust mutexes Oct 12 04:35:45.007459 dv-cinder-861032-1-smb devstack@keystone.service[93078]: thunder lock: enabled Oct 12 04:35:45.007459 dv-cinder-861032-1-smb devstack@keystone.service[93078]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 12 04:35:45.007459 dv-cinder-861032-1-smb devstack@keystone.service[93078]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 04:35:45.044354 dv-cinder-861032-1-smb devstack@keystone.service[93078]: Python main interpreter initialized at 0x55f6917089c0 Oct 12 04:35:45.044354 dv-cinder-861032-1-smb devstack@keystone.service[93078]: python threads support enabled Oct 12 04:35:45.044354 dv-cinder-861032-1-smb devstack@keystone.service[93078]: your server socket listen backlog is limited to 100 connections Oct 12 04:35:45.044354 dv-cinder-861032-1-smb devstack@keystone.service[93078]: your mercy for graceful operations on workers is 90 seconds Oct 12 04:35:45.044696 dv-cinder-861032-1-smb devstack@keystone.service[93078]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 04:35:45.044776 dv-cinder-861032-1-smb devstack@keystone.service[93078]: *** Operational MODE: preforking *** Oct 12 04:35:45.045047 dv-cinder-861032-1-smb devstack@keystone.service[93078]: *** uWSGI is running in multiple interpreter mode *** Oct 12 04:35:45.045047 dv-cinder-861032-1-smb devstack@keystone.service[93078]: spawned uWSGI master process (pid: 93078) Oct 12 04:35:45.045244 dv-cinder-861032-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 12 04:35:45.048078 dv-cinder-861032-1-smb devstack@keystone.service[93078]: spawned uWSGI worker 1 (pid: 93090, cores: 1) Oct 12 04:35:45.048078 dv-cinder-861032-1-smb devstack@keystone.service[93078]: spawned uWSGI worker 2 (pid: 93091, cores: 1) Oct 12 04:35:45.048078 dv-cinder-861032-1-smb devstack@keystone.service[93078]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 04:35:49.278304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:35:49.278304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: from cryptography.utils import int_from_bytes Oct 12 04:35:49.279097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:35:49.279097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: from cryptography.utils import int_from_bytes Oct 12 04:35:49.279668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:35:49.279668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: from cryptography.utils import int_from_bytes Oct 12 04:35:49.280121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 04:35:49.280121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: from cryptography.utils import int_from_bytes Oct 12 04:35:49.328371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 04:35:49.328562 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 04:35:49.328757 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] command line args: [] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 04:35:49.329030 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 04:35:49.329210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ================================================================================ {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 04:35:49.329466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] admin_token = **** {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.329652 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 04:35:49.329741 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] config_dir = [] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.329852 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 04:35:49.329930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.330049 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] command line args: [] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 04:35:49.330123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] config_source = [] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.330227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] debug = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.330309 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 04:35:49.330425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.330691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ================================================================================ {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 04:35:49.330760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] admin_token = **** {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.330828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.330960 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.331041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] config_dir = [] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.331141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.331248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.331382 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] config_source = [] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.331487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.331582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] debug = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.331696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] list_limit = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.331811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.331930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] log_config_append = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.332032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.332125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.332229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.332323 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] log_dir = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.332460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.332572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] log_file = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.332572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.332773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.332884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.333001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] list_limit = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.333001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] log_config_append = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.333257 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.333343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.333464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.333549 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] log_dir = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.333661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.333742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] log_file = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.333820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.333941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334211 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334520 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334604 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334781 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.334984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.335122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.335222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.335397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.335507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.335639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.335782 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.335866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.336101 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.336267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.336389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.336474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] publish_errors = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.336576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.336670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.336829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.336910 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.337065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.337143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.337309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.337541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.337616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.337752 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] publish_errors = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.337827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] standard_threads = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.337990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.338086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.338225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.338307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.338382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.338456 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.338558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] use_journal = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.338644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.338719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] use_json = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.338869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.338945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] use_stderr = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.339053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] use_syslog = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.339127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] standard_threads = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.339300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.339381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.339563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.339892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.340015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.340090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.340198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] use_journal = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.340312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.340387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] use_json = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.340541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] use_stderr = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.340619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.340720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] use_syslog = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.340803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.340955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 04:35:49.341031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.341213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.341288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.341458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.341544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.341703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.341776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.341949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.342022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.342195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.342281 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.342430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.342547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.342679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.342755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.342917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.343001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.343165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.343248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.343438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.343533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.343674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.343761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.343917 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.343998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.344302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.344424 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.344424 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.344567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.344642 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.344710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.344862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.344943 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.345083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.345159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.345346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.345422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.345596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.345669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.345829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.345909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.346060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.346133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.346290 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.346363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.346525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.346607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.346774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.346849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.347021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.347095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.347253 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.347374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.347508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.347583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.347742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.347816 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.347986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.348063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.348219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.348294 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.348468 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.348544 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.348699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.348809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.348958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.349032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.349191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.349267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.349423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.349500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.349655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.349730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.349892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.349967 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.350123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.350199 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.350359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.350433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.350598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.350674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.350820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.350892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.351047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.351122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.351302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.351390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.351533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.351613 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.351766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.351841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.352015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.352091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.352246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.352323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.352482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.352602 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.352715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.352790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.352951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.353027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.353186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.353294 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.353422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.353531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.353651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.353753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.353941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.354082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.354169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.354293 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.354368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.354486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.354561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.354676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.354795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.354868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.355019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.355099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.355247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.355342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.355507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.355608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.355741 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.355830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.355975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.356057 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.356233 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.356320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.356470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.356557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.356707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.356783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.356941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.357019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.357177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.357270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.357411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.357488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.357657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.357732 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.357893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.357982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.358129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.358213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.358371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.358455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.358606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.358690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.358844 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.358925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.359075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.359157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.359320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.359415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.359556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.359633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.359791 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.359867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.360030 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.360121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.360278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.360354 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.360518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.360592 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.360756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.360838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.360992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.361067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.361229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.361304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.361467 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.361549 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.361704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.361780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.361939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.362015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.362174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.362320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.362394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.362468 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.362638 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.362715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.362854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.362939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.363089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.363167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.363348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.363429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.363589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.363667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.363824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.363900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.364060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.364137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.364293 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.364369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.365056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.365132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.365293 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.365370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.365539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.365615 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.365768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] auth.external = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.365851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.366000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.366076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.366245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.366347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.366504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.366583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.366732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] auth.password = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.366808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.366962 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] auth.token = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.367040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.367202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.367300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] auth.external = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.367463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.367542 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.367712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.367794 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.367943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.368019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.368191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.368268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] auth.password = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.368429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] auth.token = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.368504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.368656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.368738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.368893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] credential.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.368970 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.369138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.369213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.369370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.369445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.369617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.369694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.369858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.369934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.370091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.370166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.370327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.370403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] credential.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.370571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.370649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.370820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.370895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.371054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.371131 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.371323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.371402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.371577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.371664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.371818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.371895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.372069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.372147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.372308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.372383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.372551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.372631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.372784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] federation.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.372859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.373020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.373104 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.373267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.373344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.373512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.373588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.373742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.373829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.373988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.374064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.374223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.374298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] federation.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.374474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.374563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.374710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.374787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.374963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.375044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.375196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.375291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.375466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.375543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.375701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.375777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.375946 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.376034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.376183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.376258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.376416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.376491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.376649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.376798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.376893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.376971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.377285 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.377362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.377432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.377508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.377580 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.377649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.377809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.377887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.378038 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.378131 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.378269 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.378397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.378501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.378578 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.378738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.378821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.378983 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.379070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.379229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.379323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.379489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.379583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.379727 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.379810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.379964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.380041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.380778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.380876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.381028 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.381104 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.381261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.381338 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.381500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.381584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.381731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.381808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.381967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.382044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.382208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.382292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.382447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.382527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.382696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.382772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.382927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.383005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.383160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.383235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.383432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.383513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.383668 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.383746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.383911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.383986 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.384154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.384230 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.384387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.384464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.384624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.384701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.384856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.384932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.385093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.385171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.385330 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.385406 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.385570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.385646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.385804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.385881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.386049 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.386126 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.386286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.386383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.386529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.386633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.386769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.386866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.387015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.387094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.387259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.387398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.387605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.387692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.387844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.387922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.388083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.388160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.388324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.388401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.388557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.388633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.388798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.388876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.389048 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.389123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.389279 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.389355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.389519 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.389596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.389761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.389838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.389999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.390075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.390230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.390307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.390462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.390538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.390702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.390779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.390938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.391016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.391173 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.391250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.391429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.391508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.391675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.391753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.391908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.391985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.392151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.392228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.392392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.392470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.392633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.392709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.392859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.392934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.393105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.393183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.393342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.393419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.393578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.393657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.393814 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.393892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.394048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.394125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.394290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.394365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.394534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.394611 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.394771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.394848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.395013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.395089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.395241 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.395334 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.395503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.395578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.395779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.395862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.396016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.396095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.396255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.396331 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.396504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.396581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.396738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.396816 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.396969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.397050 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.397206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.397282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.397444 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.397521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] resource.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.397686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.397763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.397929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.398005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.398167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.398245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.398400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.398475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.398642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.398726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.398875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.398989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] resource.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.399128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.399251 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.399389 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.399492 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.399629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.399706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.399863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] role.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.399940 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.400109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] role.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.400274 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.400393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.400467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.400576 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.400653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.400814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.400898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.401058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.401135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.401300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] role.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.401377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.401545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.401629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] role.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.401777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.401853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.402023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.402099 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.402272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.402356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.402505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.402633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.402759 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.402883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.403022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.403118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.403249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.403383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.403503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.403628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.403751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.403884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.404008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.404134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.404258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.404381 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.404505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.404646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.404771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.404895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.405019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.405143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.405275 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.405397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.405521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.405644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.405767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.405890 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.406021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.406146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.406280 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.406404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.406527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.406650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.406786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.406911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.407067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.407193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.407361 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.407483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.407617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.407741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.407864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.407985 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.408118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.408243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.408374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.408498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.408622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] token.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.408745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.408867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.408990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.409121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.409243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.409369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.409491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.409614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.409753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.409885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.410009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.410133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.410257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] token.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.410382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.410505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.410636 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.410759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.410882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.411006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.411129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.411270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.411428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.411564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.411690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.411814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.411938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.412061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.412192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.412317 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.412442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.412574 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.412705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.412829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.412952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.413077 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.413199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.connection = **** {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.413333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.413457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.413582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.413706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.413837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.413961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.414084 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.414216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.414347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.414470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.414595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.414719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.414719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.414961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.connection = **** {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.415097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.415222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.415362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.415488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.415622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.415747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.415870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.415993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.416116 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.416240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.416372 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.416496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.416619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.416752 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.416876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.416999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.417130 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.417254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.417378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.417502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.417625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.417750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.417880 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 04:35:49.418005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.418005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.418005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.418005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.418005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.418005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.418689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 04:35:49.418689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 04:35:49.446226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.446449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.446671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.447738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.447980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.448214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.454946 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.456571 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.482786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.483019 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.484379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.484618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.536491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.536705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.585796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.585968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.586100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.586267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.741457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.741672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.741760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.741868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.741962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.742094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.742177 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.742314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.742396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.742530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.742613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.742745 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.765974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.766097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.766249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.766422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.766508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.766582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.766655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.766795 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.766889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.767011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.767094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.767224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.767364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.767460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.778901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.779041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.791575 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.791753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.791848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.791988 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.792072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.792220 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.792303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.792445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.792537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.792657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.792739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.792871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.792953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.793085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93090) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 04:35:49.809559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.809776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 04:35:49.810098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.810180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.810308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 04:35:49.810404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 04:35:49.810586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.810666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.810832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 04:35:49.810915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.811108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.811191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.811395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.811479 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.811658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.811918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.821594 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.821878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.821965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.822156 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.822238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.822445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.822530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.822741 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.829444 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.829675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.832375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.832572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.832652 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.832862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.832941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.833194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.833789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.833989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.834075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.834284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.834365 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.834548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.834631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.834820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.834901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.835095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.835183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.835393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.835477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.835669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.835746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.835936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.858460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.858551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.859946 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.860030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.860235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.860330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.864890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.864974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.865178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.865280 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.865465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.865578 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.871742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.871932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.872013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.872228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.877540 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.877815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.877898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.878113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.878194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.878402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.878482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.878684 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.878809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.878965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.879052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.879240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.879340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.879541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.879619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.879818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.895266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.895570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.896310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.896599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.899945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.900510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.903143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.903468 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.903772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.904076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.907637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.908305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.910721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.911534 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.913955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.914257 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.914551 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.914763 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.914844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.915073 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.915160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.915394 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.915477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.915692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.915977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.916270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.930912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.931206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.931505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.931775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.932041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.932342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.932621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.932897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.938505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.939767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.940061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.941317 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.941574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.941853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.943419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.943705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.945033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.945326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.945613 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.945908 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.946312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.946538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.946832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.947131 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.947459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.947859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.957380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.957679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.957965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.958295 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.958679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.958971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.959050 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.959253 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.959403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.959601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.959899 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.960287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.960582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.960870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.975249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.977006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.978156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.979986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.981034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.982496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.982888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.983999 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.984286 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.984366 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.984693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.985831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.986124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.986537 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.991560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.993022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.993476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.994944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:49.995904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.996304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.996595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.996878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.997851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.998260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.998561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:49.998851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.004633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:50.004928 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.005242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.006775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:50.007075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.007399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.012160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93090) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:50.012450 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.012732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.013021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.013297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.013571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.013847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.014123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.014271 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 04:35:50.014393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.014565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.014679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.014855 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.014944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.015141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.015222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.015450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.015605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.015732 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.015877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93090) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.016016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.016308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.016586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.016871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.017158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.017434 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.017707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.017980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 04:35:50.049778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f6917089c0 pid: 93090 (default app) Oct 12 04:35:50.052792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f6917089c0 pid: 93091 (default app) Oct 12 04:35:50.053519 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a034d8-9b08-4d41-a2bf-411434c69fe0 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:35:50.053803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a034d8-9b08-4d41-a2bf-411434c69fe0 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:35:50.054076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a034d8-9b08-4d41-a2bf-411434c69fe0 None None] PATH_INFO: `/v3` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:35:50.058187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Oct 12 04:35:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:35:56.815119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff633b58-6583-4098-ac1d-c1e09bf0d0cd None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:35:56.815755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff633b58-6583-4098-ac1d-c1e09bf0d0cd None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:35:56.815755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff633b58-6583-4098-ac1d-c1e09bf0d0cd None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:35:56.820462 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:35:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:35:56.825742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:35:56.826263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:35:56.826359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:35:56.897070 dv-cinder-861032-1-smb devstack@keystone.service[93090]: INFO dbcounter [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] Registered counter for database keystone Oct 12 04:35:56.915675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG oslo_db.sqlalchemy.engines [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:35:56.921784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writer thread running {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 04:35:57.097881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG passlib.handlers.bcrypt [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93090) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 04:35:57.098264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG passlib.handlers.bcrypt [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93090) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 04:35:57.155820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:35:57.157371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:35:57.283981 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:35:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 04:35:57.759602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff633b58-6583-4098-ac1d-c1e09bf0d0cd None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:35:57.829166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: INFO dbcounter [None req-ff633b58-6583-4098-ac1d-c1e09bf0d0cd None None] Registered counter for database keystone Oct 12 04:35:57.850282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG oslo_db.sqlalchemy.engines [None req-ff633b58-6583-4098-ac1d-c1e09bf0d0cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 04:35:57.856686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writer thread running {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 04:35:57.976398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff633b58-6583-4098-ac1d-c1e09bf0d0cd None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:35:57.980662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40310e-12a3-4047-841f-cdbf5665b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:35:57.981287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40310e-12a3-4047-841f-cdbf5665b177 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:35:57.981572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40310e-12a3-4047-841f-cdbf5665b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:35:57.981849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40310e-12a3-4047-841f-cdbf5665b177 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:35:57.990007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40310e-12a3-4047-841f-cdbf5665b177 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:35:58.041928 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WARNING keystone.common.rbac_enforcer.enforcer [None req-af40310e-12a3-4047-841f-cdbf5665b177 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 04:35:58.042272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40310e-12a3-4047-841f-cdbf5665b177 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:35:58.051379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Oct 12 04:35:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 04:35:58.057299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:35:58.074408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b19a4-a0cc-4af7-805a-40ddf0ffa8df None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:35:58.078793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a97c6a-ae49-4336-acd1-696903a8e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:35:58.079973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a97c6a-ae49-4336-acd1-696903a8e795 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:35:58.080206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a97c6a-ae49-4336-acd1-696903a8e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:35:58.080473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a97c6a-ae49-4336-acd1-696903a8e795 admin admin] PATH_INFO: `/v3/projects/aeb630740ccb4099b311e8a52a3b6b07` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:35:58.082062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a97c6a-ae49-4336-acd1-696903a8e795 admin admin] RBAC: Authorizing `identity:get_project(project_id=aeb630740ccb4099b311e8a52a3b6b07)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:35:58.135325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WARNING keystone.common.rbac_enforcer.enforcer [None req-79a97c6a-ae49-4336-acd1-696903a8e795 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 04:35:58.135676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a97c6a-ae49-4336-acd1-696903a8e795 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:35:58.140336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 04:35:58 2022] GET /identity/v3/projects/aeb630740ccb4099b311e8a52a3b6b07 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:00.250227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfb313-7be4-4dec-973b-aedfdfe57976 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:00.250770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfb313-7be4-4dec-973b-aedfdfe57976 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:00.250770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfb313-7be4-4dec-973b-aedfdfe57976 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:00.255551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:00.260879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd38f-e957-4bea-9ea9-e7e0061affc8 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:00.261308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd38f-e957-4bea-9ea9-e7e0061affc8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:00.261441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd38f-e957-4bea-9ea9-e7e0061affc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:00.281576 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c9bdd38f-e957-4bea-9ea9-e7e0061affc8 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:00.283086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c9bdd38f-e957-4bea-9ea9-e7e0061affc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:00.291206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 04:36:00.558926 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfb313-7be4-4dec-973b-aedfdfe57976 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:00.571502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfb313-7be4-4dec-973b-aedfdfe57976 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:00.575798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2006be-7c55-4109-9a45-1928f22c15cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:00.576398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2006be-7c55-4109-9a45-1928f22c15cb admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:00.576685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2006be-7c55-4109-9a45-1928f22c15cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:00.576963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2006be-7c55-4109-9a45-1928f22c15cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:00.585201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2006be-7c55-4109-9a45-1928f22c15cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:00.586971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2006be-7c55-4109-9a45-1928f22c15cb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:00.595860 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Oct 12 04:36:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 04:36:00.601218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdd38f-e957-4bea-9ea9-e7e0061affc8 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:00.610266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdd38f-e957-4bea-9ea9-e7e0061affc8 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:00.615506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347be57-11e4-4616-b085-f59b6988d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:00.616131 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347be57-11e4-4616-b085-f59b6988d810 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:00.616414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347be57-11e4-4616-b085-f59b6988d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:00.616692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347be57-11e4-4616-b085-f59b6988d810 admin admin] PATH_INFO: `/v3/users/a3723e7b0b694f7a91766c751c166949` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:00.618011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347be57-11e4-4616-b085-f59b6988d810 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3723e7b0b694f7a91766c751c166949)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:00.619893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347be57-11e4-4616-b085-f59b6988d810 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:00.621409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Oct 12 04:36:00 2022] GET /identity/v3/users/a3723e7b0b694f7a91766c751c166949 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:02.779661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f87bf6-0d90-4fd9-b10e-c73a88ae4cb6 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:02.780166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f87bf6-0d90-4fd9-b10e-c73a88ae4cb6 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:02.780277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f87bf6-0d90-4fd9-b10e-c73a88ae4cb6 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:02.781527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:02.787221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32094db-cd99-4c25-93c8-d33413fab22f None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:02.787673 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32094db-cd99-4c25-93c8-d33413fab22f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:02.787805 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32094db-cd99-4c25-93c8-d33413fab22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:02.805778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d32094db-cd99-4c25-93c8-d33413fab22f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:02.806941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d32094db-cd99-4c25-93c8-d33413fab22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:02.856482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d68190-8b10-469d-a43c-024ffba4eae4 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:02.856686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d68190-8b10-469d-a43c-024ffba4eae4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:02.856963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d68190-8b10-469d-a43c-024ffba4eae4 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:02.858281 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:36:02.863454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ada76-1137-4045-b7b8-c953a200e99f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:02.863742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ada76-1137-4045-b7b8-c953a200e99f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:02.864026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ada76-1137-4045-b7b8-c953a200e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:02.886536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:02.905654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG passlib.handlers.bcrypt [None req-1f7ada76-1137-4045-b7b8-c953a200e99f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93091) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 04:36:02.906048 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG passlib.handlers.bcrypt [None req-1f7ada76-1137-4045-b7b8-c953a200e99f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93091) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 04:36:02.954797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-1f7ada76-1137-4045-b7b8-c953a200e99f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:02.956408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1f7ada76-1137-4045-b7b8-c953a200e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:03.055005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:03.160032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32094db-cd99-4c25-93c8-d33413fab22f None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:03.184703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:03.263544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32094db-cd99-4c25-93c8-d33413fab22f None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:03.295556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a6b8c-bc73-4a1f-b296-4f09a17203b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:03.296180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a6b8c-bc73-4a1f-b296-4f09a17203b5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:03.296461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a6b8c-bc73-4a1f-b296-4f09a17203b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:03.296737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a6b8c-bc73-4a1f-b296-4f09a17203b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:03.307878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a6b8c-bc73-4a1f-b296-4f09a17203b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-ef2a6b8c-bc73-4a1f-b296-4f09a17203b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:03.316510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:03.317414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:03.318358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:03.319005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ada76-1137-4045-b7b8-c953a200e99f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:03.323673 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a6b8c-bc73-4a1f-b296-4f09a17203b5 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:03.402283 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:03.417082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ada76-1137-4045-b7b8-c953a200e99f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:03.419272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:03.420166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a6b8c-bc73-4a1f-b296-4f09a17203b5 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:03.453152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe220f-ae14-43be-bbac-2049bfe7677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:03.453739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac38f19-d08c-4cac-b222-bba27471cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:03.453873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe220f-ae14-43be-bbac-2049bfe7677c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:03.454030 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe220f-ae14-43be-bbac-2049bfe7677c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:03.454306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe220f-ae14-43be-bbac-2049bfe7677c None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:03.454601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac38f19-d08c-4cac-b222-bba27471cc30 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:03.454880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac38f19-d08c-4cac-b222-bba27471cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:03.454973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe220f-ae14-43be-bbac-2049bfe7677c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:03.455147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac38f19-d08c-4cac-b222-bba27471cc30 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:03.455262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe220f-ae14-43be-bbac-2049bfe7677c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:03.456140 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac38f19-d08c-4cac-b222-bba27471cc30 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:03.456689 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe220f-ae14-43be-bbac-2049bfe7677c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:03.457548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac38f19-d08c-4cac-b222-bba27471cc30 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:03.469076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:03.469858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.sql.core [None req-cac38f19-d08c-4cac-b222-bba27471cc30 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 04:36:03.469858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 04:36:03.469858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [parameters: {'id': 'ecd17bad21ee452682c93bfa942993d1', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 04:36:03.469858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93091) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 04:36:03.474581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe220f-ae14-43be-bbac-2049bfe7677c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-cac38f19-d08c-4cac-b222-bba27471cc30 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application conn.query(q) Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 04:36:03.488148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application result.read() Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 04:36:03.489034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application next(self.gen) Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application yield resource Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application next(self.gen) Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise self.value Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application session.commit() Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 04:36:03.490137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self.session.flush() Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application compat.raise_( Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 04:36:03.491201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 04:36:03.492268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application conn.query(q) Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application result.read() Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 04:36:03.493367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [parameters: {'id': 'ecd17bad21ee452682c93bfa942993d1', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 04:36:03.495315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:03.496689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 8/16] 10.222.0.18 () {60 vars in 1137 bytes} [Wed Oct 12 04:36:03 2022] POST /identity/v3/domains => generated 190 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:03.497962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac38f19-d08c-4cac-b222-bba27471cc30 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:03.582208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe220f-ae14-43be-bbac-2049bfe7677c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:03.599423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac38f19-d08c-4cac-b222-bba27471cc30 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:03.615452 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665c237-384c-481c-9385-0c6f7f5ba531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:03.616085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c237-384c-481c-9385-0c6f7f5ba531 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:03.616363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c237-384c-481c-9385-0c6f7f5ba531 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:03.616643 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c237-384c-481c-9385-0c6f7f5ba531 None admin] PATH_INFO: `/v3/users/a3723e7b0b694f7a91766c751c166949` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:03.617777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665c237-384c-481c-9385-0c6f7f5ba531 None admin] RBAC: Authorizing `identity:get_user(user_id=a3723e7b0b694f7a91766c751c166949)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:03.619320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665c237-384c-481c-9385-0c6f7f5ba531 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:03.620786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:03 2022] GET /identity/v3/users/a3723e7b0b694f7a91766c751c166949 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:03.626050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665c237-384c-481c-9385-0c6f7f5ba531 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:03.633384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20d86f-e768-4e45-96f7-e76c82937da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:03.634235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d86f-e768-4e45-96f7-e76c82937da8 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:03.634518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d86f-e768-4e45-96f7-e76c82937da8 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:03.634820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20d86f-e768-4e45-96f7-e76c82937da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:03.640525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:03.652398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20d86f-e768-4e45-96f7-e76c82937da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:03.653873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20d86f-e768-4e45-96f7-e76c82937da8 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-fb20d86f-e768-4e45-96f7-e76c82937da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:36:03.670008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:03.670907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:36:03.671736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:36:03.671736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:36:03.671736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:03.671736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:03.677295 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20d86f-e768-4e45-96f7-e76c82937da8 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:03.699271 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:03.727803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665c237-384c-481c-9385-0c6f7f5ba531 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:03.760873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317156f-1921-429c-b27a-956cbd0f4c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:03.761505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317156f-1921-429c-b27a-956cbd0f4c67 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:03.761788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317156f-1921-429c-b27a-956cbd0f4c67 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:03.762069 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317156f-1921-429c-b27a-956cbd0f4c67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:03.763179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317156f-1921-429c-b27a-956cbd0f4c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:03.764655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317156f-1921-429c-b27a-956cbd0f4c67 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:03.766195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:03.771777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317156f-1921-429c-b27a-956cbd0f4c67 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:03.780612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20d86f-e768-4e45-96f7-e76c82937da8 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:03.813955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c7c92-dc9a-43e1-9bfd-014f5e62db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:03.814555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7c92-dc9a-43e1-9bfd-014f5e62db03 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:03.814835 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7c92-dc9a-43e1-9bfd-014f5e62db03 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:03.815112 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7c92-dc9a-43e1-9bfd-014f5e62db03 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:03.815792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c7c92-dc9a-43e1-9bfd-014f5e62db03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:03.816101 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c7c92-dc9a-43e1-9bfd-014f5e62db03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:03.818035 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c7c92-dc9a-43e1-9bfd-014f5e62db03 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:03.836742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:03.853175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:03.874501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317156f-1921-429c-b27a-956cbd0f4c67 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:03.909729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707f91c-c4d9-41af-855a-60320cfb6dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:03.910414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707f91c-c4d9-41af-855a-60320cfb6dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:03.910694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707f91c-c4d9-41af-855a-60320cfb6dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:03.910971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707f91c-c4d9-41af-855a-60320cfb6dc5 None admin] PATH_INFO: `/v3/domains/default/users/a3723e7b0b694f7a91766c751c166949/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:03.913549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707f91c-c4d9-41af-855a-60320cfb6dc5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a3723e7b0b694f7a91766c751c166949, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:03.915004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707f91c-c4d9-41af-855a-60320cfb6dc5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:04.029458 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Oct 12 04:36:03 2022] PUT /identity/v3/domains/default/users/a3723e7b0b694f7a91766c751c166949/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:36:06.362880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bca07b-635e-40b8-8585-9abbab415729 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:06.363425 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bca07b-635e-40b8-8585-9abbab415729 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:06.363504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bca07b-635e-40b8-8585-9abbab415729 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:06.365079 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:06.371146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5436-221e-4aed-b7a1-1076df8879ff None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:06.371606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5436-221e-4aed-b7a1-1076df8879ff None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:06.371794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5436-221e-4aed-b7a1-1076df8879ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:06.389938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a41e-c117-463c-9aa2-c1e6b509eec8 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:06.390268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a41e-c117-463c-9aa2-c1e6b509eec8 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:06.390581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a41e-c117-463c-9aa2-c1e6b509eec8 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:06.391961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 12/23] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:06.397056 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d4ed5436-221e-4aed-b7a1-1076df8879ff None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:06.398599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d4ed5436-221e-4aed-b7a1-1076df8879ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:06.399186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd341b-451f-4660-95eb-9c15dcfaa33c None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:06.399502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd341b-451f-4660-95eb-9c15dcfaa33c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:06.399788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd341b-451f-4660-95eb-9c15dcfaa33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:06.428897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6ebd341b-451f-4660-95eb-9c15dcfaa33c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:06.430120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6ebd341b-451f-4660-95eb-9c15dcfaa33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:06.535136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 13/24] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 12 04:36:06.559122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 12/25] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:06.864669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e62407-e24b-45bc-b201-ca13fa8b5189 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:06.865318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e62407-e24b-45bc-b201-ca13fa8b5189 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:06.865802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e62407-e24b-45bc-b201-ca13fa8b5189 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:06.867385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 14/26] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:06.872686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b8c94-2457-4a85-a9e4-c084f856d53e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:06.872988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b8c94-2457-4a85-a9e4-c084f856d53e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:06.873272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b8c94-2457-4a85-a9e4-c084f856d53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:06.900277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-df9b8c94-2457-4a85-a9e4-c084f856d53e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:06.901492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-df9b8c94-2457-4a85-a9e4-c084f856d53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:06.985687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:06.990907 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 13/27] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:07.003215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e62407-e24b-45bc-b201-ca13fa8b5189 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:07.020096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:07.137272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b8c94-2457-4a85-a9e4-c084f856d53e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:07.159931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e62407-e24b-45bc-b201-ca13fa8b5189 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:07.231645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cab11f-0ec5-4cc5-a465-03bd9ebaadcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:07.232282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab11f-0ec5-4cc5-a465-03bd9ebaadcd None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:07.232562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab11f-0ec5-4cc5-a465-03bd9ebaadcd None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:07.232837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab11f-0ec5-4cc5-a465-03bd9ebaadcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:07.251866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cab11f-0ec5-4cc5-a465-03bd9ebaadcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:07.253340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cab11f-0ec5-4cc5-a465-03bd9ebaadcd None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-b5cab11f-0ec5-4cc5-a465-03bd9ebaadcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:36:07.284277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:07.285192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:36:07.286530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:36:07.286530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:36:07.286530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:07.290067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 15/28] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:07.291305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd88ab-84fc-44b9-b1df-9e153b37894a None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:07.291597 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd88ab-84fc-44b9-b1df-9e153b37894a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:07.291876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd88ab-84fc-44b9-b1df-9e153b37894a None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:07.293552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 16/29] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:07.294251 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd88ab-84fc-44b9-b1df-9e153b37894a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:07.327728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b8c94-2457-4a85-a9e4-c084f856d53e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:07.366859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:07.368455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bec26f-31e7-40ff-923d-5c66d61bddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:07.369515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bec26f-31e7-40ff-923d-5c66d61bddd1 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:07.369969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bec26f-31e7-40ff-923d-5c66d61bddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:07.370508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bec26f-31e7-40ff-923d-5c66d61bddd1 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:07.371540 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bec26f-31e7-40ff-923d-5c66d61bddd1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:07.375267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bec26f-31e7-40ff-923d-5c66d61bddd1 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:07.400553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 14/30] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Oct 12 04:36:07 2022] POST /identity/v3/roles => generated 219 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:07.402665 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94637745-52da-45eb-b9f0-9121014a8acf None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:07.403128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94637745-52da-45eb-b9f0-9121014a8acf None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:07.404029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94637745-52da-45eb-b9f0-9121014a8acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:07.415974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd88ab-84fc-44b9-b1df-9e153b37894a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:07.429224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-94637745-52da-45eb-b9f0-9121014a8acf None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:07.431353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-94637745-52da-45eb-b9f0-9121014a8acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:07.457437 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ba55d-0121-44f4-8b23-c4390dad7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:07.458640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ba55d-0121-44f4-8b23-c4390dad7577 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:07.458921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ba55d-0121-44f4-8b23-c4390dad7577 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:07.459193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ba55d-0121-44f4-8b23-c4390dad7577 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:07.459959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ba55d-0121-44f4-8b23-c4390dad7577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:07.460274 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ba55d-0121-44f4-8b23-c4390dad7577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:07.461934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ba55d-0121-44f4-8b23-c4390dad7577 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:07.476880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 17/31] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:07.477865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ba55d-0121-44f4-8b23-c4390dad7577 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:07.524208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:07.554664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 15/32] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:07.555616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94637745-52da-45eb-b9f0-9121014a8acf None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:07.630235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ba55d-0121-44f4-8b23-c4390dad7577 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:07.666011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:07.685839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e67a4-3f01-4fb3-947c-3acf63b869e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:07.691952 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e67a4-3f01-4fb3-947c-3acf63b869e1 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:07.692733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e67a4-3f01-4fb3-947c-3acf63b869e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:07.693213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e67a4-3f01-4fb3-947c-3acf63b869e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:07.709120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e67a4-3f01-4fb3-947c-3acf63b869e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-3b2e67a4-3f01-4fb3-947c-3acf63b869e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:07.715877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:07.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:07.717484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:07.719805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 18/33] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:36:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:07.726885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e67a4-3f01-4fb3-947c-3acf63b869e1 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:07.801474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94637745-52da-45eb-b9f0-9121014a8acf None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:07.849651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930c256-ccc7-49bd-9788-fd5f84cbbf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:07.850662 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930c256-ccc7-49bd-9788-fd5f84cbbf25 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:07.851145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930c256-ccc7-49bd-9788-fd5f84cbbf25 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:07.851650 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930c256-ccc7-49bd-9788-fd5f84cbbf25 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:07.853244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930c256-ccc7-49bd-9788-fd5f84cbbf25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:07.855269 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930c256-ccc7-49bd-9788-fd5f84cbbf25 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:07.875172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e67a4-3f01-4fb3-947c-3acf63b869e1 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:07.902779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 16/34] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:36:07 2022] POST /identity/v3/projects => generated 301 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:07.950092 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3b14-a64b-40df-80df-5f565e5d1c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:07.951005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3b14-a64b-40df-80df-5f565e5d1c2a None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:07.951471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3b14-a64b-40df-80df-5f565e5d1c2a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:07.951902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3b14-a64b-40df-80df-5f565e5d1c2a None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:07.952737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3b14-a64b-40df-80df-5f565e5d1c2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:07.953199 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3b14-a64b-40df-80df-5f565e5d1c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:07.954779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3b14-a64b-40df-80df-5f565e5d1c2a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:07.959961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589e750-057e-4353-bc72-6e833c5a8901 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:07.960308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589e750-057e-4353-bc72-6e833c5a8901 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:07.960647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589e750-057e-4353-bc72-6e833c5a8901 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:07.962564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 17/35] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:36:07.968324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70d6e-3839-4c8a-b6a7-dc35371a6873 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:07.968627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70d6e-3839-4c8a-b6a7-dc35371a6873 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:07.968914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70d6e-3839-4c8a-b6a7-dc35371a6873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:07.977379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 19/36] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:07.993229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3b14-a64b-40df-80df-5f565e5d1c2a None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:07.996756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-92c70d6e-3839-4c8a-b6a7-dc35371a6873 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:07.998060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-92c70d6e-3839-4c8a-b6a7-dc35371a6873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:08.049276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:08.073819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:08.099084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 18/37] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:08.103985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70d6e-3839-4c8a-b6a7-dc35371a6873 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:08.154296 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3b14-a64b-40df-80df-5f565e5d1c2a None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:08.192982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087dead-6f11-4202-a735-cc620e5c189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:08.194596 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087dead-6f11-4202-a735-cc620e5c189d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:08.194874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087dead-6f11-4202-a735-cc620e5c189d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:08.195145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087dead-6f11-4202-a735-cc620e5c189d None admin] PATH_INFO: `/v3/users/a3723e7b0b694f7a91766c751c166949` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:08.196668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087dead-6f11-4202-a735-cc620e5c189d None admin] RBAC: Authorizing `identity:get_user(user_id=a3723e7b0b694f7a91766c751c166949)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:08.198117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087dead-6f11-4202-a735-cc620e5c189d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:08.199983 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:07 2022] GET /identity/v3/users/a3723e7b0b694f7a91766c751c166949 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:08.206068 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087dead-6f11-4202-a735-cc620e5c189d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:08.238299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70d6e-3839-4c8a-b6a7-dc35371a6873 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:08.292238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69773521-297c-4ca5-9e6c-1c8a650f5e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:08.293645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69773521-297c-4ca5-9e6c-1c8a650f5e4f None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:08.294354 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69773521-297c-4ca5-9e6c-1c8a650f5e4f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:08.294808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69773521-297c-4ca5-9e6c-1c8a650f5e4f None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:08.295892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69773521-297c-4ca5-9e6c-1c8a650f5e4f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:08.298084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69773521-297c-4ca5-9e6c-1c8a650f5e4f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:08.316126 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Oct 12 04:36:08 2022] POST /identity/v3/roles => generated 225 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:08.350916 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087dead-6f11-4202-a735-cc620e5c189d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:08.362320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03254dd7-ca12-4d5d-92bd-d3499c9b797b None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:08.362622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03254dd7-ca12-4d5d-92bd-d3499c9b797b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:08.362891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03254dd7-ca12-4d5d-92bd-d3499c9b797b None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:08.365663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 20/40] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:08.367341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:08.372135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fcb1d-fa2b-4453-b534-92ff04a25173 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:08.372603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fcb1d-fa2b-4453-b534-92ff04a25173 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:08.373187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fcb1d-fa2b-4453-b534-92ff04a25173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:08.392749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-683fcb1d-fa2b-4453-b534-92ff04a25173 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:08.393984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-683fcb1d-fa2b-4453-b534-92ff04a25173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:08.394213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf82670-bcf7-4f1e-9f6a-120b3aa5f124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:08.394874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf82670-bcf7-4f1e-9f6a-120b3aa5f124 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:08.395151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf82670-bcf7-4f1e-9f6a-120b3aa5f124 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:08.395989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf82670-bcf7-4f1e-9f6a-120b3aa5f124 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:08.397304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf82670-bcf7-4f1e-9f6a-120b3aa5f124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:08.398892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf82670-bcf7-4f1e-9f6a-120b3aa5f124 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:08.401901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 21/41] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:08.409636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf82670-bcf7-4f1e-9f6a-120b3aa5f124 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:08.425862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:08.478461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 21/42] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:08.484311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fcb1d-fa2b-4453-b534-92ff04a25173 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:08.529784 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf82670-bcf7-4f1e-9f6a-120b3aa5f124 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:08.574401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b76702-1a39-49a3-99bf-d175a6f3f50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:08.575211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76702-1a39-49a3-99bf-d175a6f3f50b None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:08.575528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76702-1a39-49a3-99bf-d175a6f3f50b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:08.575802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76702-1a39-49a3-99bf-d175a6f3f50b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:08.576545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b76702-1a39-49a3-99bf-d175a6f3f50b None admin] RBAC: Adding query filter params (role.id=3d2307e73cdb4f6291f9735ac9359702, scope.domain.id=default, user.id=a3723e7b0b694f7a91766c751c166949) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:08.576853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b76702-1a39-49a3-99bf-d175a6f3f50b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:08.578327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b76702-1a39-49a3-99bf-d175a6f3f50b None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:08.590884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Oct 12 04:36:08 2022] GET /identity/v3/role_assignments?user.id=a3723e7b0b694f7a91766c751c166949&scope.domain.id=default&role.id=3d2307e73cdb4f6291f9735ac9359702 => generated 530 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:08.709590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fcb1d-fa2b-4453-b534-92ff04a25173 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:08.748733 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b8fbd-3a59-4b2d-aa5d-c0b06210ffe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:08.749709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b8fbd-3a59-4b2d-aa5d-c0b06210ffe3 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:08.750196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b8fbd-3a59-4b2d-aa5d-c0b06210ffe3 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:08.750669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b8fbd-3a59-4b2d-aa5d-c0b06210ffe3 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:08.751608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b8fbd-3a59-4b2d-aa5d-c0b06210ffe3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:08.753221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b8fbd-3a59-4b2d-aa5d-c0b06210ffe3 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:08.757458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b76702-1a39-49a3-99bf-d175a6f3f50b None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:08.772234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Oct 12 04:36:08 2022] POST /identity/v3/roles => generated 223 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:08.819241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:08.877923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b76702-1a39-49a3-99bf-d175a6f3f50b None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:08.915042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df92dc2-b874-4ab9-bcfc-0c9b4ced34fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:08.915753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df92dc2-b874-4ab9-bcfc-0c9b4ced34fe None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:08.916041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df92dc2-b874-4ab9-bcfc-0c9b4ced34fe None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:08.916319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df92dc2-b874-4ab9-bcfc-0c9b4ced34fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:08.917482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df92dc2-b874-4ab9-bcfc-0c9b4ced34fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:08.918963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df92dc2-b874-4ab9-bcfc-0c9b4ced34fe None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:08.920602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 23/45] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:08.926401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b8fbd-3a59-4b2d-aa5d-c0b06210ffe3 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:08.952261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:09.031305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b8fbd-3a59-4b2d-aa5d-c0b06210ffe3 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:09.068227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2eecd-6515-4bc3-bae1-82800f324404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:09.068834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2eecd-6515-4bc3-bae1-82800f324404 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:09.069120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2eecd-6515-4bc3-bae1-82800f324404 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:09.069398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2eecd-6515-4bc3-bae1-82800f324404 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:09.070046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2eecd-6515-4bc3-bae1-82800f324404 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:09.071504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2eecd-6515-4bc3-bae1-82800f324404 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:09.097174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:36:08 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:11.208800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58280-7610-4b5d-8da7-423d1fdc36ce None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:11.209339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58280-7610-4b5d-8da7-423d1fdc36ce None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:11.209339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58280-7610-4b5d-8da7-423d1fdc36ce None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:11.210681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:11.216543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89ddf5-99b0-4dc1-81a3-c2bd3e02ee15 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:11.216945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89ddf5-99b0-4dc1-81a3-c2bd3e02ee15 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:11.217107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89ddf5-99b0-4dc1-81a3-c2bd3e02ee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:11.234725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-cf89ddf5-99b0-4dc1-81a3-c2bd3e02ee15 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:11.235944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cf89ddf5-99b0-4dc1-81a3-c2bd3e02ee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:11.299931 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:11.564269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec58280-7610-4b5d-8da7-423d1fdc36ce None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:11.663244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec58280-7610-4b5d-8da7-423d1fdc36ce None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:11.675765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:11.696525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd2028-2e6c-4b8e-a99b-d9c394cb6e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:11.697138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd2028-2e6c-4b8e-a99b-d9c394cb6e11 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:11.697423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd2028-2e6c-4b8e-a99b-d9c394cb6e11 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:11.697698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd2028-2e6c-4b8e-a99b-d9c394cb6e11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:11.699055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd2028-2e6c-4b8e-a99b-d9c394cb6e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:11.700532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd2028-2e6c-4b8e-a99b-d9c394cb6e11 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:11.702056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:11.707569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89ddf5-99b0-4dc1-81a3-c2bd3e02ee15 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:11.711201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:11.805832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89ddf5-99b0-4dc1-81a3-c2bd3e02ee15 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:11.838864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b49ae-8fcd-48f2-8510-9944c7607dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:11.839449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b49ae-8fcd-48f2-8510-9944c7607dd6 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:11.839738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b49ae-8fcd-48f2-8510-9944c7607dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:11.840270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b49ae-8fcd-48f2-8510-9944c7607dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:11.840924 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b49ae-8fcd-48f2-8510-9944c7607dd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:11.842357 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b49ae-8fcd-48f2-8510-9944c7607dd6 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:11.867907 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Oct 12 04:36:11 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:13.984838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de988f-dab5-4fa6-b390-3d58b83ef1ff None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:13.985327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de988f-dab5-4fa6-b390-3d58b83ef1ff None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:13.985429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de988f-dab5-4fa6-b390-3d58b83ef1ff None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:13.986696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 26/51] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:13.991868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b2d1a-921f-4dcd-b0d9-9001fae71c49 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:13.992239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b2d1a-921f-4dcd-b0d9-9001fae71c49 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:13.992437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b2d1a-921f-4dcd-b0d9-9001fae71c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:14.010673 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-ab6b2d1a-921f-4dcd-b0d9-9001fae71c49 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:14.011894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ab6b2d1a-921f-4dcd-b0d9-9001fae71c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:14.060040 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:14.076980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 26/52] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:14.341814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de988f-dab5-4fa6-b390-3d58b83ef1ff None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:14.438655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de988f-dab5-4fa6-b390-3d58b83ef1ff None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:14.471040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166cd30-2c4f-4c45-8e6c-3fef1db8e6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:14.471677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166cd30-2c4f-4c45-8e6c-3fef1db8e6ee None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:14.471960 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166cd30-2c4f-4c45-8e6c-3fef1db8e6ee None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:14.472228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166cd30-2c4f-4c45-8e6c-3fef1db8e6ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:14.473833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166cd30-2c4f-4c45-8e6c-3fef1db8e6ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:14.475253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166cd30-2c4f-4c45-8e6c-3fef1db8e6ee None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:14.476779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:14.482206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b2d1a-921f-4dcd-b0d9-9001fae71c49 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:14.578734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b2d1a-921f-4dcd-b0d9-9001fae71c49 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:14.611675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2a971-cd9e-4f63-9fa4-7c7219cb5473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:14.612229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2a971-cd9e-4f63-9fa4-7c7219cb5473 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:14.612512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2a971-cd9e-4f63-9fa4-7c7219cb5473 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:14.612781 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2a971-cd9e-4f63-9fa4-7c7219cb5473 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:14.613414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2a971-cd9e-4f63-9fa4-7c7219cb5473 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:14.615420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2a971-cd9e-4f63-9fa4-7c7219cb5473 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:14.641260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 27/54] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:36:14 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:17.764298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1d99-c28c-445e-8056-90be47648a60 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:17.764845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1d99-c28c-445e-8056-90be47648a60 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:17.764845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1d99-c28c-445e-8056-90be47648a60 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:17.766278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 28/55] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:17.780872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c731-ab2b-44ab-8572-70b33ec51d4b None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:17.781321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c731-ab2b-44ab-8572-70b33ec51d4b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:17.781416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c731-ab2b-44ab-8572-70b33ec51d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:17.812344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-e8f7c731-ab2b-44ab-8572-70b33ec51d4b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:17.813555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e8f7c731-ab2b-44ab-8572-70b33ec51d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:17.840149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658fe12-117b-4ea2-a347-07a7af8e8004 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:17.840365 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658fe12-117b-4ea2-a347-07a7af8e8004 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:17.840827 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658fe12-117b-4ea2-a347-07a7af8e8004 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:17.842365 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 29/56] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:36:17.855681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2cae-4edb-4031-84d0-0d515b0fe657 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:17.856159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2cae-4edb-4031-84d0-0d515b0fe657 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:17.856577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2cae-4edb-4031-84d0-0d515b0fe657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:17.857712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:17.880525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-9a3e2cae-4edb-4031-84d0-0d515b0fe657 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:17.882388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9a3e2cae-4edb-4031-84d0-0d515b0fe657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:17.920290 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 28/57] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:17.947620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:17.979064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 30/58] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:18.145698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c6684-f21a-4d81-b363-4fd505b17609 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.145993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c6684-f21a-4d81-b363-4fd505b17609 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.146725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c6684-f21a-4d81-b363-4fd505b17609 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.148405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 29/59] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:18.153415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4d959-911b-4eb5-9982-d259d40be797 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.153708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4d959-911b-4eb5-9982-d259d40be797 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.153987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4d959-911b-4eb5-9982-d259d40be797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.174638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-78f4d959-911b-4eb5-9982-d259d40be797 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:18.175919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-78f4d959-911b-4eb5-9982-d259d40be797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:18.197547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c6684-f21a-4d81-b363-4fd505b17609 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:18.282154 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 31/60] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:18.340630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4d959-911b-4eb5-9982-d259d40be797 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:18.340835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c6684-f21a-4d81-b363-4fd505b17609 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:18.406405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3b989-4c9a-42f7-80cf-cf48841c08f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:18.406971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b989-4c9a-42f7-80cf-cf48841c08f6 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.407257 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b989-4c9a-42f7-80cf-cf48841c08f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.412529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b989-4c9a-42f7-80cf-cf48841c08f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.429679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3b989-4c9a-42f7-80cf-cf48841c08f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-27d3b989-4c9a-42f7-80cf-cf48841c08f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:18.434606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:18.435472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:18.436227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:18.445309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3b989-4c9a-42f7-80cf-cf48841c08f6 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:18.485484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:18.535424 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4d959-911b-4eb5-9982-d259d40be797 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:18.549817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:18.584789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50473836-c158-4435-9ad9-8fa62d6bfe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:18.585427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473836-c158-4435-9ad9-8fa62d6bfe5c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.585705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473836-c158-4435-9ad9-8fa62d6bfe5c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.585974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473836-c158-4435-9ad9-8fa62d6bfe5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.599925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50473836-c158-4435-9ad9-8fa62d6bfe5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-50473836-c158-4435-9ad9-8fa62d6bfe5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:18.606398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:18.607242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:18.608042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:18.608615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 32/62] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:18.609316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50473836-c158-4435-9ad9-8fa62d6bfe5c None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:18.624049 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3b989-4c9a-42f7-80cf-cf48841c08f6 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:18.663107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9ffec-4498-48c8-b096-26da299a8854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:18.664105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ffec-4498-48c8-b096-26da299a8854 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.664609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ffec-4498-48c8-b096-26da299a8854 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.665080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ffec-4498-48c8-b096-26da299a8854 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.666086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9ffec-4498-48c8-b096-26da299a8854 None admin] RBAC: Adding query filter params (name=member) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:18.666649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9ffec-4498-48c8-b096-26da299a8854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:18.668677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9ffec-4498-48c8-b096-26da299a8854 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:18.678972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 31/63] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:18.679912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9ffec-4498-48c8-b096-26da299a8854 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:18.740760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50473836-c158-4435-9ad9-8fa62d6bfe5c None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:18.776394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:18.779425 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ba8a2-2b6c-439d-9420-7fafeee069d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:18.780058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ba8a2-2b6c-439d-9420-7fafeee069d9 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.780340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ba8a2-2b6c-439d-9420-7fafeee069d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.780608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ba8a2-2b6c-439d-9420-7fafeee069d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.783438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9ffec-4498-48c8-b096-26da299a8854 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:18.790616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ba8a2-2b6c-439d-9420-7fafeee069d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-ea8ba8a2-2b6c-439d-9420-7fafeee069d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:18.795405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:18.796257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:18.797067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 33/64] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:36:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:18.797766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096576c5-2cb7-4d7e-81fe-69c7ad770337 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.798415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096576c5-2cb7-4d7e-81fe-69c7ad770337 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.798415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096576c5-2cb7-4d7e-81fe-69c7ad770337 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.799841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 34/65] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:18.800543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096576c5-2cb7-4d7e-81fe-69c7ad770337 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:18.822343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e5c96-0ea3-4e03-bab5-cf95b8ae131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:18.822957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e5c96-0ea3-4e03-bab5-cf95b8ae131b None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.823244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e5c96-0ea3-4e03-bab5-cf95b8ae131b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.823554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e5c96-0ea3-4e03-bab5-cf95b8ae131b None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.824217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e5c96-0ea3-4e03-bab5-cf95b8ae131b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:18.824524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e5c96-0ea3-4e03-bab5-cf95b8ae131b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:18.825898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e5c96-0ea3-4e03-bab5-cf95b8ae131b None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:18.828555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:18.838901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 32/66] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:18.838901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c5acc-9a23-4416-8a90-3d3f6a06498b None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.838901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c5acc-9a23-4416-8a90-3d3f6a06498b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.838901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c5acc-9a23-4416-8a90-3d3f6a06498b None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.838901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 33/67] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:18.841997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c5acc-9a23-4416-8a90-3d3f6a06498b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:18.903800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096576c5-2cb7-4d7e-81fe-69c7ad770337 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:18.936957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1736af3-c0c4-4bde-ad12-ba295841d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:18.937520 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1736af3-c0c4-4bde-ad12-ba295841d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.937800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1736af3-c0c4-4bde-ad12-ba295841d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.938078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1736af3-c0c4-4bde-ad12-ba295841d5b0 None admin] PATH_INFO: `/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.940853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c5acc-9a23-4416-8a90-3d3f6a06498b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:18.952871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1736af3-c0c4-4bde-ad12-ba295841d5b0 None admin] RBAC: Authorizing `identity:get_user(user_id=e0bb918e2d4a4c2bb8397e90b95b6925)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:18.954353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1736af3-c0c4-4bde-ad12-ba295841d5b0 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:18.955960 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 35/68] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:18 2022] GET /identity/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:18.957086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79927982-0bb3-4ea5-9dbe-3bb244841db0 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.957371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79927982-0bb3-4ea5-9dbe-3bb244841db0 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.957646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79927982-0bb3-4ea5-9dbe-3bb244841db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.975373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-79927982-0bb3-4ea5-9dbe-3bb244841db0 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:18.976573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-79927982-0bb3-4ea5-9dbe-3bb244841db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:18.979029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397016bd-35a1-4513-8aac-5d9a786742f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:18.980376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397016bd-35a1-4513-8aac-5d9a786742f3 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:18.980669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397016bd-35a1-4513-8aac-5d9a786742f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:18.980957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397016bd-35a1-4513-8aac-5d9a786742f3 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:18.981626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397016bd-35a1-4513-8aac-5d9a786742f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:18.981937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397016bd-35a1-4513-8aac-5d9a786742f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:18.983321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397016bd-35a1-4513-8aac-5d9a786742f3 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:18.991254 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:36:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:18.992077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397016bd-35a1-4513-8aac-5d9a786742f3 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.010954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:19.046051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 36/70] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:19.055602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb4f70-a278-4f38-abd7-1ecf6f007cf2 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.055602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb4f70-a278-4f38-abd7-1ecf6f007cf2 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.055602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb4f70-a278-4f38-abd7-1ecf6f007cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.064995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-07fb4f70-a278-4f38-abd7-1ecf6f007cf2 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:19.066171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-07fb4f70-a278-4f38-abd7-1ecf6f007cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:19.076691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:19.111162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397016bd-35a1-4513-8aac-5d9a786742f3 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:19.133526 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 37/71] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:19.134180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb4f70-a278-4f38-abd7-1ecf6f007cf2 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.157430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a958f39-0e7d-4871-acdf-3057e3b21a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:19.158577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a958f39-0e7d-4871-acdf-3057e3b21a0c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.159037 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a958f39-0e7d-4871-acdf-3057e3b21a0c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.159755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a958f39-0e7d-4871-acdf-3057e3b21a0c None admin] PATH_INFO: `/v3/users/a3723e7b0b694f7a91766c751c166949` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.161444 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a958f39-0e7d-4871-acdf-3057e3b21a0c None admin] RBAC: Authorizing `identity:get_user(user_id=a3723e7b0b694f7a91766c751c166949)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:19.163645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a958f39-0e7d-4871-acdf-3057e3b21a0c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:19.166147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 35/72] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:18 2022] GET /identity/v3/users/a3723e7b0b694f7a91766c751c166949 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:19.167416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a958f39-0e7d-4871-acdf-3057e3b21a0c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.260919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb4f70-a278-4f38-abd7-1ecf6f007cf2 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:19.269092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:19.285169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a958f39-0e7d-4871-acdf-3057e3b21a0c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:19.306561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df94f3-94a9-4c22-a75e-5d0aa79a29ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:19.307698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df94f3-94a9-4c22-a75e-5d0aa79a29ea None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.308170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df94f3-94a9-4c22-a75e-5d0aa79a29ea None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.308736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df94f3-94a9-4c22-a75e-5d0aa79a29ea None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.310601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df94f3-94a9-4c22-a75e-5d0aa79a29ea None admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:19.312740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df94f3-94a9-4c22-a75e-5d0aa79a29ea None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:19.314969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 38/73] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:19 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:19.316487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df94f3-94a9-4c22-a75e-5d0aa79a29ea None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.320680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90a4a7-34f0-4b7e-85b2-cc17a2dccdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:19.321328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90a4a7-34f0-4b7e-85b2-cc17a2dccdb9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.321615 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90a4a7-34f0-4b7e-85b2-cc17a2dccdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.321944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90a4a7-34f0-4b7e-85b2-cc17a2dccdb9 None admin] PATH_INFO: `/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.323150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90a4a7-34f0-4b7e-85b2-cc17a2dccdb9 None admin] RBAC: Authorizing `identity:get_user(user_id=e0bb918e2d4a4c2bb8397e90b95b6925)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:19.324646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90a4a7-34f0-4b7e-85b2-cc17a2dccdb9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:19.326447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 36/74] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:19 2022] GET /identity/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:19.327589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90a4a7-34f0-4b7e-85b2-cc17a2dccdb9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.335233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:19.434696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90a4a7-34f0-4b7e-85b2-cc17a2dccdb9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:19.471395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94fa8-62a9-487b-988c-62a77ac34460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:19.472047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94fa8-62a9-487b-988c-62a77ac34460 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.472334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94fa8-62a9-487b-988c-62a77ac34460 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.472612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94fa8-62a9-487b-988c-62a77ac34460 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.484204 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b94fa8-62a9-487b-988c-62a77ac34460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-36b94fa8-62a9-487b-988c-62a77ac34460 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:19.489653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:19.491197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:19.492005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:19.492631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94fa8-62a9-487b-988c-62a77ac34460 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.509326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:19.528497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df94f3-94a9-4c22-a75e-5d0aa79a29ea None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:19.564662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06277d-d6d5-4b26-8b43-28a8bed09a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:19.565291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06277d-d6d5-4b26-8b43-28a8bed09a76 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.565580 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06277d-d6d5-4b26-8b43-28a8bed09a76 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.565856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06277d-d6d5-4b26-8b43-28a8bed09a76 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.566972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06277d-d6d5-4b26-8b43-28a8bed09a76 None admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:19.569019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06277d-d6d5-4b26-8b43-28a8bed09a76 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:19.570621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:19 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:19.571404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06277d-d6d5-4b26-8b43-28a8bed09a76 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.597719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94fa8-62a9-487b-988c-62a77ac34460 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:19.630936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe51c5-ecb5-4ebc-81d8-98c2d367f0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:19.631957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe51c5-ecb5-4ebc-81d8-98c2d367f0bd None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.632252 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe51c5-ecb5-4ebc-81d8-98c2d367f0bd None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.632532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe51c5-ecb5-4ebc-81d8-98c2d367f0bd None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8/users/e0bb918e2d4a4c2bb8397e90b95b6925/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.634478 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe51c5-ecb5-4ebc-81d8-98c2d367f0bd None admin] RBAC: Authorizing `identity:create_grant(project_id=e783a7bd858944dabed6fde83e3328e8, user_id=e0bb918e2d4a4c2bb8397e90b95b6925, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:19.635980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe51c5-ecb5-4ebc-81d8-98c2d367f0bd None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:19.650027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 38/77] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:36:19 2022] PUT /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8/users/e0bb918e2d4a4c2bb8397e90b95b6925/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:36:19.650836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe51c5-ecb5-4ebc-81d8-98c2d367f0bd None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.652359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:19.678238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06277d-d6d5-4b26-8b43-28a8bed09a76 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:19.718904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de196f3e-d59e-4579-ac9c-729b23035749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:19.719587 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de196f3e-d59e-4579-ac9c-729b23035749 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.719919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de196f3e-d59e-4579-ac9c-729b23035749 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.720197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de196f3e-d59e-4579-ac9c-729b23035749 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.721530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de196f3e-d59e-4579-ac9c-729b23035749 None admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:19.723044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de196f3e-d59e-4579-ac9c-729b23035749 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:19.725294 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 40/78] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:19 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:19.726090 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de196f3e-d59e-4579-ac9c-729b23035749 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.753762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:19.786424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe51c5-ecb5-4ebc-81d8-98c2d367f0bd None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:19.825135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7baee4-eccc-42bf-a8d1-cbad1f81963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:19.825783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7baee4-eccc-42bf-a8d1-cbad1f81963a None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.826067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7baee4-eccc-42bf-a8d1-cbad1f81963a None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.826345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7baee4-eccc-42bf-a8d1-cbad1f81963a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.827563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7baee4-eccc-42bf-a8d1-cbad1f81963a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:19.829305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7baee4-eccc-42bf-a8d1-cbad1f81963a None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:19.831034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 39/79] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:19.831995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7baee4-eccc-42bf-a8d1-cbad1f81963a None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.845357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de196f3e-d59e-4579-ac9c-729b23035749 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:19.883715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf5e50-9b22-4959-8c49-99f423c87aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:19.884327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf5e50-9b22-4959-8c49-99f423c87aed None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.884611 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf5e50-9b22-4959-8c49-99f423c87aed None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.884878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf5e50-9b22-4959-8c49-99f423c87aed None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.885547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf5e50-9b22-4959-8c49-99f423c87aed None admin] RBAC: Adding query filter params (name=member) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:19.885855 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf5e50-9b22-4959-8c49-99f423c87aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:19.887215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf5e50-9b22-4959-8c49-99f423c87aed None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:19.896686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 41/80] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:19.901300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf5e50-9b22-4959-8c49-99f423c87aed None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:19.915374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:19.944110 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7baee4-eccc-42bf-a8d1-cbad1f81963a None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:19.982536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde024d8-005e-4853-8bb4-7bd48193d301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:19.983212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde024d8-005e-4853-8bb4-7bd48193d301 None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:19.983533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde024d8-005e-4853-8bb4-7bd48193d301 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:19.983817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde024d8-005e-4853-8bb4-7bd48193d301 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8/users/a3723e7b0b694f7a91766c751c166949/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:19.985740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde024d8-005e-4853-8bb4-7bd48193d301 None admin] RBAC: Authorizing `identity:create_grant(project_id=e783a7bd858944dabed6fde83e3328e8, user_id=a3723e7b0b694f7a91766c751c166949, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:19.987274 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde024d8-005e-4853-8bb4-7bd48193d301 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:20.007852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 40/81] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:36:19 2022] PUT /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8/users/a3723e7b0b694f7a91766c751c166949/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:36:20.007852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde024d8-005e-4853-8bb4-7bd48193d301 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:20.007852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:20.024460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf5e50-9b22-4959-8c49-99f423c87aed None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:20.073077 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af44d-94a6-4f21-ab0a-8c1f85092075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:20.074180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af44d-94a6-4f21-ab0a-8c1f85092075 None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:20.074466 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af44d-94a6-4f21-ab0a-8c1f85092075 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:20.074747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af44d-94a6-4f21-ab0a-8c1f85092075 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8/users/e0bb918e2d4a4c2bb8397e90b95b6925/roles/50ea03120ffe45e196a21607ebe0cc8a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:20.077711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54af44d-94a6-4f21-ab0a-8c1f85092075 None admin] RBAC: Authorizing `identity:create_grant(project_id=e783a7bd858944dabed6fde83e3328e8, user_id=e0bb918e2d4a4c2bb8397e90b95b6925, role_id=50ea03120ffe45e196a21607ebe0cc8a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:20.079196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54af44d-94a6-4f21-ab0a-8c1f85092075 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:20.143814 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde024d8-005e-4853-8bb4-7bd48193d301 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:20.183633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d1232-e7ae-47d4-8f5a-899c0703839b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:20.184255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d1232-e7ae-47d4-8f5a-899c0703839b None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:20.184548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d1232-e7ae-47d4-8f5a-899c0703839b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:20.184850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d1232-e7ae-47d4-8f5a-899c0703839b None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:20.185544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d1232-e7ae-47d4-8f5a-899c0703839b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:20.187056 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d1232-e7ae-47d4-8f5a-899c0703839b None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:20.213191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 41/82] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:36:20 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:20.214124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d1232-e7ae-47d4-8f5a-899c0703839b None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:20.217993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 42/83] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:36:19 2022] PUT /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8/users/e0bb918e2d4a4c2bb8397e90b95b6925/roles/50ea03120ffe45e196a21607ebe0cc8a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:36:20.288372 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:20.342669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d1232-e7ae-47d4-8f5a-899c0703839b None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:20.392127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdace26a-a264-4d47-8732-c457b1a27276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:20.392817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdace26a-a264-4d47-8732-c457b1a27276 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:20.393164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdace26a-a264-4d47-8732-c457b1a27276 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:20.393460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdace26a-a264-4d47-8732-c457b1a27276 None admin] PATH_INFO: `/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:20.400317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdace26a-a264-4d47-8732-c457b1a27276 None admin] RBAC: Authorizing `identity:get_user(user_id=e0bb918e2d4a4c2bb8397e90b95b6925)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:20.401835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdace26a-a264-4d47-8732-c457b1a27276 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:20.403592 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 42/84] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:20 2022] GET /identity/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:20.409865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af44d-94a6-4f21-ab0a-8c1f85092075 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:20.491216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:20.525129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af44d-94a6-4f21-ab0a-8c1f85092075 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:20.572489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65591e50-88e4-4edf-9f13-fc9460deaf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:20.573629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65591e50-88e4-4edf-9f13-fc9460deaf28 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:20.573915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65591e50-88e4-4edf-9f13-fc9460deaf28 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:20.574196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65591e50-88e4-4edf-9f13-fc9460deaf28 None admin] PATH_INFO: `/v3/projects/5ba1be722f354019bbca4f0f9578358b` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:20.575691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65591e50-88e4-4edf-9f13-fc9460deaf28 None admin] RBAC: Authorizing `identity:get_project(project_id=5ba1be722f354019bbca4f0f9578358b)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:20.577395 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65591e50-88e4-4edf-9f13-fc9460deaf28 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:20.581931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 43/85] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:20 2022] GET /identity/v3/projects/5ba1be722f354019bbca4f0f9578358b => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:20.587992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdace26a-a264-4d47-8732-c457b1a27276 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:20.714845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdace26a-a264-4d47-8732-c457b1a27276 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:20.745488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:20.757160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e273-ff66-45de-ad76-b5c63d050aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:20.758032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e273-ff66-45de-ad76-b5c63d050aeb None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:20.758486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e273-ff66-45de-ad76-b5c63d050aeb None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:20.758909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e273-ff66-45de-ad76-b5c63d050aeb None admin] PATH_INFO: `/v3/projects/5ba1be722f354019bbca4f0f9578358b/users/e0bb918e2d4a4c2bb8397e90b95b6925/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:20.761101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22e273-ff66-45de-ad76-b5c63d050aeb None admin] RBAC: Authorizing `identity:create_grant(project_id=5ba1be722f354019bbca4f0f9578358b, user_id=e0bb918e2d4a4c2bb8397e90b95b6925, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:20.762753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22e273-ff66-45de-ad76-b5c63d050aeb None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:20.777598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 43/86] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:36:20 2022] PUT /identity/v3/projects/5ba1be722f354019bbca4f0f9578358b/users/e0bb918e2d4a4c2bb8397e90b95b6925/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:36:22.030320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68e0d9-ca7f-4d9c-9907-d603160a1af0 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:22.030828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68e0d9-ca7f-4d9c-9907-d603160a1af0 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:22.030900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68e0d9-ca7f-4d9c-9907-d603160a1af0 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:22.032416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 44/87] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:36:22.049147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8223629-23bf-40e4-972d-61b31c0e676c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:22.050069 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8223629-23bf-40e4-972d-61b31c0e676c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:22.050543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8223629-23bf-40e4-972d-61b31c0e676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:22.080315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c8223629-23bf-40e4-972d-61b31c0e676c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:22.081836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c8223629-23bf-40e4-972d-61b31c0e676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:22.169658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 44/88] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:22.717656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68e0d9-ca7f-4d9c-9907-d603160a1af0 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:22.811789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fee8d-ee8f-4a44-b51d-06ef5c0f32c7 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:22.812099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fee8d-ee8f-4a44-b51d-06ef5c0f32c7 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:22.812364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fee8d-ee8f-4a44-b51d-06ef5c0f32c7 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:22.813725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 45/89] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:36:22.819710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef110f-9ae5-41eb-967f-f2ceeed5b811 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:22.820002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef110f-9ae5-41eb-967f-f2ceeed5b811 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:22.820286 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef110f-9ae5-41eb-967f-f2ceeed5b811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:22.838221 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68e0d9-ca7f-4d9c-9907-d603160a1af0 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:22.856295 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-71ef110f-9ae5-41eb-967f-f2ceeed5b811 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:22.857508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-71ef110f-9ae5-41eb-967f-f2ceeed5b811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:22.874583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422b0fa-3c18-47a8-8f26-202dfcc6cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:22.875232 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422b0fa-3c18-47a8-8f26-202dfcc6cc3d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:22.875545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422b0fa-3c18-47a8-8f26-202dfcc6cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:22.875827 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422b0fa-3c18-47a8-8f26-202dfcc6cc3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:22.884820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:22.889491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422b0fa-3c18-47a8-8f26-202dfcc6cc3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-0422b0fa-3c18-47a8-8f26-202dfcc6cc3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:22.895259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:22.896197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:22.896946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 45/90] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:22.904620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422b0fa-3c18-47a8-8f26-202dfcc6cc3d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:23.011451 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 46/91] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:23.012823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c0855-62a8-45b6-ab97-330c2d5a7159 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:23.013123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c0855-62a8-45b6-ab97-330c2d5a7159 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:23.013407 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c0855-62a8-45b6-ab97-330c2d5a7159 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:23.014660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 47/92] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:23.024456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e846-a107-4ba3-8d78-926c347e218b None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:23.024752 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e846-a107-4ba3-8d78-926c347e218b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:23.025042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6e846-a107-4ba3-8d78-926c347e218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:23.031906 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422b0fa-3c18-47a8-8f26-202dfcc6cc3d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:23.061483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-71e6e846-a107-4ba3-8d78-926c347e218b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:23.062729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-71e6e846-a107-4ba3-8d78-926c347e218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:23.067779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe55e-889b-4caf-acae-0264aed6c28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:23.069232 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe55e-889b-4caf-acae-0264aed6c28c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:23.069518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe55e-889b-4caf-acae-0264aed6c28c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:23.069800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefe55e-889b-4caf-acae-0264aed6c28c None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:23.070478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefe55e-889b-4caf-acae-0264aed6c28c None admin] RBAC: Adding query filter params (name=member) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:23.070790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefe55e-889b-4caf-acae-0264aed6c28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:23.072214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefe55e-889b-4caf-acae-0264aed6c28c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:23.082393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 46/93] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:23.088713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe55e-889b-4caf-acae-0264aed6c28c None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:23.162282 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:23.172719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:23.217829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefe55e-889b-4caf-acae-0264aed6c28c None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:23.221245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 48/94] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:23.262420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7ac61-3bf0-4ebe-b3af-304bc9d60aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:23.263065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ac61-3bf0-4ebe-b3af-304bc9d60aee None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:23.263374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ac61-3bf0-4ebe-b3af-304bc9d60aee None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:23.263662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7ac61-3bf0-4ebe-b3af-304bc9d60aee None admin] PATH_INFO: `/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:23.267984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7ac61-3bf0-4ebe-b3af-304bc9d60aee None admin] RBAC: Authorizing `identity:get_user(user_id=e0bb918e2d4a4c2bb8397e90b95b6925)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:23.269444 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7ac61-3bf0-4ebe-b3af-304bc9d60aee None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:23.271557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 47/95] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:23 2022] GET /identity/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:23.277320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6e846-a107-4ba3-8d78-926c347e218b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:23.416001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7ac61-3bf0-4ebe-b3af-304bc9d60aee None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:23.431574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6e846-a107-4ba3-8d78-926c347e218b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:23.496908 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd4721-5eb8-486e-80de-3385f85ef76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:23.497533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd4721-5eb8-486e-80de-3385f85ef76c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:23.497823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd4721-5eb8-486e-80de-3385f85ef76c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:23.498107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd4721-5eb8-486e-80de-3385f85ef76c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:23.556577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7ac61-3bf0-4ebe-b3af-304bc9d60aee None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:23.587703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:23.587849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:23.604278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adde5e9-8c51-491a-94aa-169d497f8495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:23.604935 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde5e9-8c51-491a-94aa-169d497f8495 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:23.605224 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde5e9-8c51-491a-94aa-169d497f8495 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:23.605510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde5e9-8c51-491a-94aa-169d497f8495 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:23.627474 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adde5e9-8c51-491a-94aa-169d497f8495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:23.630224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd4721-5eb8-486e-80de-3385f85ef76c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:23.632277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd4721-5eb8-486e-80de-3385f85ef76c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-4adde5e9-8c51-491a-94aa-169d497f8495 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:23.637824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:23.638759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:23.639557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:36:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:23.640171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adde5e9-8c51-491a-94aa-169d497f8495 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:23.753395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 49/97] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:23.754273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd4721-5eb8-486e-80de-3385f85ef76c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:23.827715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adde5e9-8c51-491a-94aa-169d497f8495 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:23.873918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:23.895808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3da7c5-9081-48c0-8e34-e0cb6e599811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:23.897150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3da7c5-9081-48c0-8e34-e0cb6e599811 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:23.897443 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3da7c5-9081-48c0-8e34-e0cb6e599811 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:23.897723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3da7c5-9081-48c0-8e34-e0cb6e599811 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:23.918714 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3da7c5-9081-48c0-8e34-e0cb6e599811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-7a3da7c5-9081-48c0-8e34-e0cb6e599811 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:23.924819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:23.925759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:23.926495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 49/98] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:36:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:23.927114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3da7c5-9081-48c0-8e34-e0cb6e599811 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:23.933409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd4721-5eb8-486e-80de-3385f85ef76c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:23.994984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b2033-ea12-4f59-a86b-63c1317df8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:23.995644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b2033-ea12-4f59-a86b-63c1317df8d2 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:23.995929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b2033-ea12-4f59-a86b-63c1317df8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:23.996207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b2033-ea12-4f59-a86b-63c1317df8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:23.996877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b2033-ea12-4f59-a86b-63c1317df8d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:23.997182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b2033-ea12-4f59-a86b-63c1317df8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:23.998582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b2033-ea12-4f59-a86b-63c1317df8d2 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:24.023485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 50/99] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:24.024284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b2033-ea12-4f59-a86b-63c1317df8d2 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:24.041019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:24.099493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3da7c5-9081-48c0-8e34-e0cb6e599811 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:24.141222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d60be-714b-45cd-b1d2-b47c07038c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:24.141867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d60be-714b-45cd-b1d2-b47c07038c02 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.142185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d60be-714b-45cd-b1d2-b47c07038c02 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.142465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d60be-714b-45cd-b1d2-b47c07038c02 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.143633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d60be-714b-45cd-b1d2-b47c07038c02 None admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:24.145086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d60be-714b-45cd-b1d2-b47c07038c02 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:24.147408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 50/100] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:23 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:24.148092 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d60be-714b-45cd-b1d2-b47c07038c02 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:24.154697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b2033-ea12-4f59-a86b-63c1317df8d2 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:24.190139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc50eed-0da9-4d42-bf97-89f27c4955c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:24.190757 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc50eed-0da9-4d42-bf97-89f27c4955c6 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.191044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc50eed-0da9-4d42-bf97-89f27c4955c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.191349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc50eed-0da9-4d42-bf97-89f27c4955c6 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.192168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc50eed-0da9-4d42-bf97-89f27c4955c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:24.192318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc50eed-0da9-4d42-bf97-89f27c4955c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:24.194235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc50eed-0da9-4d42-bf97-89f27c4955c6 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:24.199815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:24.208461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 51/101] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:36:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:24.209684 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dd1cd-c2bf-407d-b811-dc09de97dd40 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.210131 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dd1cd-c2bf-407d-b811-dc09de97dd40 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.210299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dd1cd-c2bf-407d-b811-dc09de97dd40 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.211526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 52/102] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:24.216226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74be99b-af42-487b-aa7f-96b8df4eb38f None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.216226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74be99b-af42-487b-aa7f-96b8df4eb38f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.216226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74be99b-af42-487b-aa7f-96b8df4eb38f None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.216226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 53/103] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:24.216226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74be99b-af42-487b-aa7f-96b8df4eb38f None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:24.267722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d60be-714b-45cd-b1d2-b47c07038c02 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:24.289438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:24.308673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd5d4a-6ca8-4576-ac89-b1acc62d3ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:24.309373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd5d4a-6ca8-4576-ac89-b1acc62d3ded None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.309669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd5d4a-6ca8-4576-ac89-b1acc62d3ded None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.309954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd5d4a-6ca8-4576-ac89-b1acc62d3ded None admin] PATH_INFO: `/v3/users/a3723e7b0b694f7a91766c751c166949` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.311123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd5d4a-6ca8-4576-ac89-b1acc62d3ded None admin] RBAC: Authorizing `identity:get_user(user_id=a3723e7b0b694f7a91766c751c166949)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:24.312612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd5d4a-6ca8-4576-ac89-b1acc62d3ded None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:24.314358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 51/104] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:24 2022] GET /identity/v3/users/a3723e7b0b694f7a91766c751c166949 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:24.315045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd5d4a-6ca8-4576-ac89-b1acc62d3ded None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:24.334021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74be99b-af42-487b-aa7f-96b8df4eb38f None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:24.370404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a1cf3-7765-4b55-adb2-6b0e594907a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:24.371025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a1cf3-7765-4b55-adb2-6b0e594907a5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.371327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a1cf3-7765-4b55-adb2-6b0e594907a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.371608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a1cf3-7765-4b55-adb2-6b0e594907a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.372339 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a1cf3-7765-4b55-adb2-6b0e594907a5 None admin] RBAC: Adding query filter params (role.id=d39456c8f0144ddeba3555d56fc50e3a, scope.project.id=e783a7bd858944dabed6fde83e3328e8, user.id=e0bb918e2d4a4c2bb8397e90b95b6925) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:24.372651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a1cf3-7765-4b55-adb2-6b0e594907a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:24.374079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a1cf3-7765-4b55-adb2-6b0e594907a5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:24.381716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 54/105] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:36:24 2022] GET /identity/v3/role_assignments?user.id=e0bb918e2d4a4c2bb8397e90b95b6925&scope.project.id=e783a7bd858944dabed6fde83e3328e8&role.id=d39456c8f0144ddeba3555d56fc50e3a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:24.382884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ceb46-d0e4-4ee5-a5a0-3e702c502fb5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.383132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ceb46-d0e4-4ee5-a5a0-3e702c502fb5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.383447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ceb46-d0e4-4ee5-a5a0-3e702c502fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.404410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-302ceb46-d0e4-4ee5-a5a0-3e702c502fb5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:24.405657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-302ceb46-d0e4-4ee5-a5a0-3e702c502fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:24.433398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd5d4a-6ca8-4576-ac89-b1acc62d3ded None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:24.474939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:24.478157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e2c72-e635-412b-8fdc-60bca0402b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:24.478836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e2c72-e635-412b-8fdc-60bca0402b7d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.479433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e2c72-e635-412b-8fdc-60bca0402b7d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.479735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e2c72-e635-412b-8fdc-60bca0402b7d None admin] PATH_INFO: `/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.481698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e2c72-e635-412b-8fdc-60bca0402b7d None admin] RBAC: Authorizing `identity:get_user(user_id=e0bb918e2d4a4c2bb8397e90b95b6925)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:24.483255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e2c72-e635-412b-8fdc-60bca0402b7d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:24.485121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 55/106] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:24.485482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 52/107] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:24 2022] GET /identity/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:24.486299 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e2c72-e635-412b-8fdc-60bca0402b7d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:24.491749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d314b5-7ab2-4fbc-b92b-61b000f3a021 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.492043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d314b5-7ab2-4fbc-b92b-61b000f3a021 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.492393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d314b5-7ab2-4fbc-b92b-61b000f3a021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.511675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b5d314b5-7ab2-4fbc-b92b-61b000f3a021 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:24.512881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b5d314b5-7ab2-4fbc-b92b-61b000f3a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:24.570061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:24.605207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 56/108] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:24.607097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c53b89-f40c-4d04-8976-27aacc0b9a38 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.607561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c53b89-f40c-4d04-8976-27aacc0b9a38 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.608006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c53b89-f40c-4d04-8976-27aacc0b9a38 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.609502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 57/109] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:24.610396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c53b89-f40c-4d04-8976-27aacc0b9a38 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:24.627829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e2c72-e635-412b-8fdc-60bca0402b7d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:24.667771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba799415-3df5-4b43-9d09-89fe5a6b6e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:24.668525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799415-3df5-4b43-9d09-89fe5a6b6e93 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.668917 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799415-3df5-4b43-9d09-89fe5a6b6e93 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.669297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799415-3df5-4b43-9d09-89fe5a6b6e93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.725282 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c53b89-f40c-4d04-8976-27aacc0b9a38 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:24.742136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba799415-3df5-4b43-9d09-89fe5a6b6e93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:24.744755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba799415-3df5-4b43-9d09-89fe5a6b6e93 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:24.752010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:24.764975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84247468-81e6-444c-8d01-e74ea499c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:24.765872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84247468-81e6-444c-8d01-e74ea499c713 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.766443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84247468-81e6-444c-8d01-e74ea499c713 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.766910 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84247468-81e6-444c-8d01-e74ea499c713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.801035 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:24.842586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84247468-81e6-444c-8d01-e74ea499c713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:24.845123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84247468-81e6-444c-8d01-e74ea499c713 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:24.851576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 53/110] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:24.851576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9101756-a252-4a18-81a4-36efaed1eebe None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:24.851576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9101756-a252-4a18-81a4-36efaed1eebe None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:24.851576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9101756-a252-4a18-81a4-36efaed1eebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:24.870902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-a9101756-a252-4a18-81a4-36efaed1eebe None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:24.872429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a9101756-a252-4a18-81a4-36efaed1eebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:24.940100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 54/111] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:24.951530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9101756-a252-4a18-81a4-36efaed1eebe None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:24.953498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 58/112] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:24.954365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84247468-81e6-444c-8d01-e74ea499c713 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:24.978555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:25.035698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:25.055072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84247468-81e6-444c-8d01-e74ea499c713 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.056104 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9101756-a252-4a18-81a4-36efaed1eebe None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.089111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a083c0-78a8-43f1-9c92-0f21ee9883a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.089738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a083c0-78a8-43f1-9c92-0f21ee9883a2 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.090284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a083c0-78a8-43f1-9c92-0f21ee9883a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.090563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a083c0-78a8-43f1-9c92-0f21ee9883a2 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.091081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12435b05-5864-495c-8cc5-c08873f8c948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.091739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12435b05-5864-495c-8cc5-c08873f8c948 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.091833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a083c0-78a8-43f1-9c92-0f21ee9883a2 None admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:25.092022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12435b05-5864-495c-8cc5-c08873f8c948 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.092294 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12435b05-5864-495c-8cc5-c08873f8c948 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.093264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a083c0-78a8-43f1-9c92-0f21ee9883a2 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:25.095143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 59/113] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:24 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:25.095947 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a083c0-78a8-43f1-9c92-0f21ee9883a2 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.107630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12435b05-5864-495c-8cc5-c08873f8c948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-12435b05-5864-495c-8cc5-c08873f8c948 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:25.113168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:25.114032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 55/114] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:25.115929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12435b05-5864-495c-8cc5-c08873f8c948 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.195177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:25.204808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a083c0-78a8-43f1-9c92-0f21ee9883a2 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.225362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12435b05-5864-495c-8cc5-c08873f8c948 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.238941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb7dfa-3f44-466f-98ec-0814a4f0ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.239609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7dfa-3f44-466f-98ec-0814a4f0ab53 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.240505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7dfa-3f44-466f-98ec-0814a4f0ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.240783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7dfa-3f44-466f-98ec-0814a4f0ab53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.250731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb7dfa-3f44-466f-98ec-0814a4f0ab53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-d3fb7dfa-3f44-466f-98ec-0814a4f0ab53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:25.256043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:25.256875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:25.257633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 60/115] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:25.258251 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb7dfa-3f44-466f-98ec-0814a4f0ab53 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.261699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb0f9b-ab05-4f53-8c56-bdea8b9dd892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.262657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb0f9b-ab05-4f53-8c56-bdea8b9dd892 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.262657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb0f9b-ab05-4f53-8c56-bdea8b9dd892 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.262863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb0f9b-ab05-4f53-8c56-bdea8b9dd892 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.264120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb0f9b-ab05-4f53-8c56-bdea8b9dd892 None admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:25.265572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb0f9b-ab05-4f53-8c56-bdea8b9dd892 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:25.272348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 56/116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:25.272348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb0f9b-ab05-4f53-8c56-bdea8b9dd892 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.284826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:25.356757 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb7dfa-3f44-466f-98ec-0814a4f0ab53 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.368151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb0f9b-ab05-4f53-8c56-bdea8b9dd892 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.388025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db241b-9d8f-4e23-853d-04b6ff25bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.388627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db241b-9d8f-4e23-853d-04b6ff25bd94 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.388906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db241b-9d8f-4e23-853d-04b6ff25bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.389179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db241b-9d8f-4e23-853d-04b6ff25bd94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.389891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db241b-9d8f-4e23-853d-04b6ff25bd94 None admin] RBAC: Adding query filter params (role.id=3d2307e73cdb4f6291f9735ac9359702, scope.project.id=e783a7bd858944dabed6fde83e3328e8, user.id=a3723e7b0b694f7a91766c751c166949) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:25.390196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db241b-9d8f-4e23-853d-04b6ff25bd94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:25.391673 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db241b-9d8f-4e23-853d-04b6ff25bd94 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:25.397676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 61/117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/role_assignments?user.id=a3723e7b0b694f7a91766c751c166949&scope.project.id=e783a7bd858944dabed6fde83e3328e8&role.id=3d2307e73cdb4f6291f9735ac9359702 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:25.398437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db241b-9d8f-4e23-853d-04b6ff25bd94 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.401585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ee55-163e-46e8-8cd2-a529e8090af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.402206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ee55-163e-46e8-8cd2-a529e8090af1 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.402490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ee55-163e-46e8-8cd2-a529e8090af1 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.402797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ee55-163e-46e8-8cd2-a529e8090af1 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.403502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ee55-163e-46e8-8cd2-a529e8090af1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:25.403813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ee55-163e-46e8-8cd2-a529e8090af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:25.405223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ee55-163e-46e8-8cd2-a529e8090af1 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:25.415477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 57/118] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:25.415477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ee55-163e-46e8-8cd2-a529e8090af1 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.435504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:25.501419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:25.530380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db241b-9d8f-4e23-853d-04b6ff25bd94 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.531639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ee55-163e-46e8-8cd2-a529e8090af1 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.572687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0f1b3-ca06-49d1-b4f0-c0146c99ab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.573341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0f1b3-ca06-49d1-b4f0-c0146c99ab05 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.573620 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0f1b3-ca06-49d1-b4f0-c0146c99ab05 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.574930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0f1b3-ca06-49d1-b4f0-c0146c99ab05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.576778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0f1b3-ca06-49d1-b4f0-c0146c99ab05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:25.578178 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169447c5-ba0d-4e5e-a749-cb3da10c2167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.578664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0f1b3-ca06-49d1-b4f0-c0146c99ab05 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:25.578793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169447c5-ba0d-4e5e-a749-cb3da10c2167 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.579076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169447c5-ba0d-4e5e-a749-cb3da10c2167 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.579374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169447c5-ba0d-4e5e-a749-cb3da10c2167 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.580045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169447c5-ba0d-4e5e-a749-cb3da10c2167 None admin] RBAC: Adding query filter params (name=member) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:25.581098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 62/119] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:25.581098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0f1b3-ca06-49d1-b4f0-c0146c99ab05 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.585497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169447c5-ba0d-4e5e-a749-cb3da10c2167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:25.587915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169447c5-ba0d-4e5e-a749-cb3da10c2167 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:25.598933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 58/120] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:25.600442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169447c5-ba0d-4e5e-a749-cb3da10c2167 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.675192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:25.691229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0f1b3-ca06-49d1-b4f0-c0146c99ab05 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.701407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169447c5-ba0d-4e5e-a749-cb3da10c2167 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.724571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af9a22-ffb3-4359-98bd-0935be636bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.725188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af9a22-ffb3-4359-98bd-0935be636bd5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.725468 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af9a22-ffb3-4359-98bd-0935be636bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.725774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af9a22-ffb3-4359-98bd-0935be636bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.726490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af9a22-ffb3-4359-98bd-0935be636bd5 None admin] RBAC: Adding query filter params (role.id=50ea03120ffe45e196a21607ebe0cc8a, scope.project.id=e783a7bd858944dabed6fde83e3328e8, user.id=e0bb918e2d4a4c2bb8397e90b95b6925) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:25.726796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af9a22-ffb3-4359-98bd-0935be636bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:25.728254 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af9a22-ffb3-4359-98bd-0935be636bd5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:25.733788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 63/121] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/role_assignments?user.id=e0bb918e2d4a4c2bb8397e90b95b6925&scope.project.id=e783a7bd858944dabed6fde83e3328e8&role.id=50ea03120ffe45e196a21607ebe0cc8a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:25.734535 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af9a22-ffb3-4359-98bd-0935be636bd5 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.735064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97952417-67ef-4d10-a190-6d1707e7d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.735728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97952417-67ef-4d10-a190-6d1707e7d4cc None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.736014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97952417-67ef-4d10-a190-6d1707e7d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.736295 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97952417-67ef-4d10-a190-6d1707e7d4cc None admin] PATH_INFO: `/v3/users/3567ba9142c84cd6a6e08415670fffc1` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.739935 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:25.751608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97952417-67ef-4d10-a190-6d1707e7d4cc None admin] RBAC: Authorizing `identity:get_user(user_id=3567ba9142c84cd6a6e08415670fffc1)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:25.753090 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97952417-67ef-4d10-a190-6d1707e7d4cc None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:25.754954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 59/122] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/users/3567ba9142c84cd6a6e08415670fffc1 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:25.756804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97952417-67ef-4d10-a190-6d1707e7d4cc None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.866386 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af9a22-ffb3-4359-98bd-0935be636bd5 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.877962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97952417-67ef-4d10-a190-6d1707e7d4cc None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:25.909720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7e4f8-e487-418c-b755-f0fa5aba8f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.910343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7e4f8-e487-418c-b755-f0fa5aba8f01 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.910624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7e4f8-e487-418c-b755-f0fa5aba8f01 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.910918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7e4f8-e487-418c-b755-f0fa5aba8f01 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.912108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7e4f8-e487-418c-b755-f0fa5aba8f01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:25.913547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7e4f8-e487-418c-b755-f0fa5aba8f01 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:25.917462 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca6178-e8d1-41e3-857a-87809afcf529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:25.918111 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca6178-e8d1-41e3-857a-87809afcf529 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:25.918399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca6178-e8d1-41e3-857a-87809afcf529 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:25.918680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca6178-e8d1-41e3-857a-87809afcf529 None admin] PATH_INFO: `/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:25.921149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca6178-e8d1-41e3-857a-87809afcf529 None admin] RBAC: Authorizing `identity:get_user(user_id=e0bb918e2d4a4c2bb8397e90b95b6925)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:25.921746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca6178-e8d1-41e3-857a-87809afcf529 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:25.924582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 60/123] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/users/e0bb918e2d4a4c2bb8397e90b95b6925 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:25.925261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca6178-e8d1-41e3-857a-87809afcf529 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:25.937875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:25.946113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 64/124] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:36:25 2022] POST /identity/v3/projects => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:25.947206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7e4f8-e487-418c-b755-f0fa5aba8f01 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:26.003498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:26.049948 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca6178-e8d1-41e3-857a-87809afcf529 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:26.077705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7e4f8-e487-418c-b755-f0fa5aba8f01 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:26.088027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ebe18-6351-4175-8cfb-16c669372444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:26.088677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ebe18-6351-4175-8cfb-16c669372444 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:26.088961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ebe18-6351-4175-8cfb-16c669372444 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:26.089239 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ebe18-6351-4175-8cfb-16c669372444 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:26.090737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ebe18-6351-4175-8cfb-16c669372444 None admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:26.092772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ebe18-6351-4175-8cfb-16c669372444 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:26.095069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 61/125] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:26.101010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ebe18-6351-4175-8cfb-16c669372444 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:26.127153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22f0cc-2f3e-458e-a48d-8d6d2d8aa16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:26.128065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22f0cc-2f3e-458e-a48d-8d6d2d8aa16a None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:26.128682 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22f0cc-2f3e-458e-a48d-8d6d2d8aa16a None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:26.128972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22f0cc-2f3e-458e-a48d-8d6d2d8aa16a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:26.198088 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:26.200899 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22f0cc-2f3e-458e-a48d-8d6d2d8aa16a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:26.203161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22f0cc-2f3e-458e-a48d-8d6d2d8aa16a None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:26.218250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ebe18-6351-4175-8cfb-16c669372444 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:26.250012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:26.257564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2915b69-19d2-4498-b1ee-8f83a76a183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:26.258231 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2915b69-19d2-4498-b1ee-8f83a76a183f None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:26.258909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2915b69-19d2-4498-b1ee-8f83a76a183f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:26.258909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2915b69-19d2-4498-b1ee-8f83a76a183f None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8/users/3567ba9142c84cd6a6e08415670fffc1/roles/df5b4de3caab4392b267395849fda6b3` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:26.260751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2915b69-19d2-4498-b1ee-8f83a76a183f None admin] RBAC: Authorizing `identity:create_grant(project_id=e783a7bd858944dabed6fde83e3328e8, user_id=3567ba9142c84cd6a6e08415670fffc1, role_id=df5b4de3caab4392b267395849fda6b3)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:26.262705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2915b69-19d2-4498-b1ee-8f83a76a183f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:26.275314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 62/126] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:36:26 2022] PUT /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8/users/3567ba9142c84cd6a6e08415670fffc1/roles/df5b4de3caab4392b267395849fda6b3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:36:26.313636 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 65/127] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:26.319748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2915b69-19d2-4498-b1ee-8f83a76a183f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:26.428717 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2915b69-19d2-4498-b1ee-8f83a76a183f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:26.464816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f563043-4366-4671-955e-5f07e3e43737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:26.466171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f563043-4366-4671-955e-5f07e3e43737 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:26.466694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f563043-4366-4671-955e-5f07e3e43737 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:26.467157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f563043-4366-4671-955e-5f07e3e43737 None admin] PATH_INFO: `/v3/projects/5ba1be722f354019bbca4f0f9578358b` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:26.468696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f563043-4366-4671-955e-5f07e3e43737 None admin] RBAC: Authorizing `identity:get_project(project_id=5ba1be722f354019bbca4f0f9578358b)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:26.470381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f563043-4366-4671-955e-5f07e3e43737 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:26.472600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 63/128] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:26 2022] GET /identity/v3/projects/5ba1be722f354019bbca4f0f9578358b => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:26.478685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22f0cc-2f3e-458e-a48d-8d6d2d8aa16a None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:26.583862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:26.586977 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22f0cc-2f3e-458e-a48d-8d6d2d8aa16a None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:26.623951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640827fc-a98e-4528-aafa-1315ba3d125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:26.624646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640827fc-a98e-4528-aafa-1315ba3d125f None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:26.624997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640827fc-a98e-4528-aafa-1315ba3d125f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:26.625340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640827fc-a98e-4528-aafa-1315ba3d125f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:26.626130 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640827fc-a98e-4528-aafa-1315ba3d125f None admin] RBAC: Adding query filter params (role.id=d39456c8f0144ddeba3555d56fc50e3a, scope.project.id=5ba1be722f354019bbca4f0f9578358b, user.id=e0bb918e2d4a4c2bb8397e90b95b6925) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:26.626510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640827fc-a98e-4528-aafa-1315ba3d125f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:26.628061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640827fc-a98e-4528-aafa-1315ba3d125f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:26.634746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 66/129] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:36:26 2022] GET /identity/v3/role_assignments?user.id=e0bb918e2d4a4c2bb8397e90b95b6925&scope.project.id=5ba1be722f354019bbca4f0f9578358b&role.id=d39456c8f0144ddeba3555d56fc50e3a => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:28.143615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d164-975b-4f48-8452-8f9c0498c6e6 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:28.144186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d164-975b-4f48-8452-8f9c0498c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:28.144186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d164-975b-4f48-8452-8f9c0498c6e6 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:28.145522 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 64/130] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:28.150716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7caaf1-7029-4756-98c3-b75bbc5abc2e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:28.151161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7caaf1-7029-4756-98c3-b75bbc5abc2e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:28.151258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7caaf1-7029-4756-98c3-b75bbc5abc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:28.169394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-da7caaf1-7029-4756-98c3-b75bbc5abc2e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:28.170578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-da7caaf1-7029-4756-98c3-b75bbc5abc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:28.236317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 67/131] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:28.469465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f887f-360e-486a-a193-044c744807f2 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:28.469756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f887f-360e-486a-a193-044c744807f2 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:28.470034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f887f-360e-486a-a193-044c744807f2 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:28.471394 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 65/132] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:28.477255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a634186-115f-444c-8602-5046488b834f None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:28.477550 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a634186-115f-444c-8602-5046488b834f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:28.477833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a634186-115f-444c-8602-5046488b834f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:28.495353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-4a634186-115f-444c-8602-5046488b834f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:28.496563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4a634186-115f-444c-8602-5046488b834f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:28.502974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f887f-360e-486a-a193-044c744807f2 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:28.561432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 68/133] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:28.564633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:28.609761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f887f-360e-486a-a193-044c744807f2 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:28.641233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56fba4-499a-495c-99e8-6a8fa29f4e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:28.641849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56fba4-499a-495c-99e8-6a8fa29f4e55 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:28.642129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56fba4-499a-495c-99e8-6a8fa29f4e55 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:28.642404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56fba4-499a-495c-99e8-6a8fa29f4e55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:28.643517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56fba4-499a-495c-99e8-6a8fa29f4e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:28.644949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56fba4-499a-495c-99e8-6a8fa29f4e55 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:28.647020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 66/134] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:28.652574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a634186-115f-444c-8602-5046488b834f None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:28.677316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:28.748500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a634186-115f-444c-8602-5046488b834f None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:28.780636 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90e5aa-5ae9-4c2d-828b-a46124c6cbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:28.781503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e5aa-5ae9-4c2d-828b-a46124c6cbbd None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:28.781786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e5aa-5ae9-4c2d-828b-a46124c6cbbd None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:28.782058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e5aa-5ae9-4c2d-828b-a46124c6cbbd None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:28.782693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90e5aa-5ae9-4c2d-828b-a46124c6cbbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:28.784146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90e5aa-5ae9-4c2d-828b-a46124c6cbbd None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:28.804886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 69/135] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:36:28 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:28.827680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56fba4-499a-495c-99e8-6a8fa29f4e55 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:28.932208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56fba4-499a-495c-99e8-6a8fa29f4e55 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:28.958833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:28.968240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f771e02-fbcb-40dd-91c5-04dac9c0f413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:28.968868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f771e02-fbcb-40dd-91c5-04dac9c0f413 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:28.969148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f771e02-fbcb-40dd-91c5-04dac9c0f413 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:28.969417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f771e02-fbcb-40dd-91c5-04dac9c0f413 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:28.981665 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f771e02-fbcb-40dd-91c5-04dac9c0f413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-0f771e02-fbcb-40dd-91c5-04dac9c0f413 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:28.986709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:28.987613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:28.988482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 67/136] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:28.995993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90e5aa-5ae9-4c2d-828b-a46124c6cbbd None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:29.080407 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:29.103376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90e5aa-5ae9-4c2d-828b-a46124c6cbbd None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:29.136848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33b96f-7789-46e9-a6e3-7cbf68f907e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:29.137469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b96f-7789-46e9-a6e3-7cbf68f907e7 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:29.137755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b96f-7789-46e9-a6e3-7cbf68f907e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:29.138034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33b96f-7789-46e9-a6e3-7cbf68f907e7 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:29.138697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33b96f-7789-46e9-a6e3-7cbf68f907e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:29.139003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33b96f-7789-46e9-a6e3-7cbf68f907e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:29.140433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33b96f-7789-46e9-a6e3-7cbf68f907e7 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:29.149971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 70/137] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:29.155461 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f771e02-fbcb-40dd-91c5-04dac9c0f413 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:29.264768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f771e02-fbcb-40dd-91c5-04dac9c0f413 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:29.303486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847193-4e9e-4dd3-b4ee-0edf35bcd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:29.304463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847193-4e9e-4dd3-b4ee-0edf35bcd439 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:29.304948 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847193-4e9e-4dd3-b4ee-0edf35bcd439 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:29.305446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847193-4e9e-4dd3-b4ee-0edf35bcd439 None admin] PATH_INFO: `/v3/users/3567ba9142c84cd6a6e08415670fffc1` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:29.306829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61847193-4e9e-4dd3-b4ee-0edf35bcd439 None admin] RBAC: Authorizing `identity:get_user(user_id=3567ba9142c84cd6a6e08415670fffc1)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:29.308313 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61847193-4e9e-4dd3-b4ee-0edf35bcd439 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:29.310137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 68/138] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:29 2022] GET /identity/v3/users/3567ba9142c84cd6a6e08415670fffc1 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:29.315611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33b96f-7789-46e9-a6e3-7cbf68f907e7 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:29.422862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33b96f-7789-46e9-a6e3-7cbf68f907e7 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:29.458758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a21584-f23e-4186-94ba-c534f9da9da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:29.459742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a21584-f23e-4186-94ba-c534f9da9da7 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:29.460227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a21584-f23e-4186-94ba-c534f9da9da7 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:29.460716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a21584-f23e-4186-94ba-c534f9da9da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:29.475053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:29.535537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a21584-f23e-4186-94ba-c534f9da9da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:29.537856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a21584-f23e-4186-94ba-c534f9da9da7 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:29.653592 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 71/139] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:29.658861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847193-4e9e-4dd3-b4ee-0edf35bcd439 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:29.719025 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:29.773162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847193-4e9e-4dd3-b4ee-0edf35bcd439 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:29.812469 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee66d09-556c-421e-9bc3-dccdada1ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:29.813372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66d09-556c-421e-9bc3-dccdada1ea39 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:29.813867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66d09-556c-421e-9bc3-dccdada1ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:29.814305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66d09-556c-421e-9bc3-dccdada1ea39 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:29.815627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee66d09-556c-421e-9bc3-dccdada1ea39 None admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:29.817214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee66d09-556c-421e-9bc3-dccdada1ea39 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:29.819385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 69/140] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:29 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:29.828504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a21584-f23e-4186-94ba-c534f9da9da7 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:29.874661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:29.936488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a21584-f23e-4186-94ba-c534f9da9da7 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:29.972315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ede966-dbda-4953-9d6c-d3ec46a1ad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:29.972892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ede966-dbda-4953-9d6c-d3ec46a1ad73 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:29.973180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ede966-dbda-4953-9d6c-d3ec46a1ad73 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:29.973460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ede966-dbda-4953-9d6c-d3ec46a1ad73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:29.974335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ede966-dbda-4953-9d6c-d3ec46a1ad73 None admin] RBAC: Adding query filter params (role.id=df5b4de3caab4392b267395849fda6b3, scope.project.id=e783a7bd858944dabed6fde83e3328e8, user.id=3567ba9142c84cd6a6e08415670fffc1) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:29.974657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ede966-dbda-4953-9d6c-d3ec46a1ad73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:29.976169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ede966-dbda-4953-9d6c-d3ec46a1ad73 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:29.983083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 72/141] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:36:29 2022] GET /identity/v3/role_assignments?user.id=3567ba9142c84cd6a6e08415670fffc1&scope.project.id=e783a7bd858944dabed6fde83e3328e8&role.id=df5b4de3caab4392b267395849fda6b3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:31.053180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148b121-da69-4e9d-8a66-e920f35dbd13 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.053705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148b121-da69-4e9d-8a66-e920f35dbd13 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.053780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148b121-da69-4e9d-8a66-e920f35dbd13 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.055065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 70/142] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:31.064727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762f87e-1b0f-4552-b352-bacec8c70ef5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.065142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762f87e-1b0f-4552-b352-bacec8c70ef5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.065279 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762f87e-1b0f-4552-b352-bacec8c70ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.105231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-0762f87e-1b0f-4552-b352-bacec8c70ef5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:31.106441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0762f87e-1b0f-4552-b352-bacec8c70ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:31.180995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 73/143] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:31.282844 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdb191-63a3-4eab-a844-de3ae0963806 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.283190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdb191-63a3-4eab-a844-de3ae0963806 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.283442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdb191-63a3-4eab-a844-de3ae0963806 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.284924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 71/144] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:31.290922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1d8b3-ecee-4885-b584-9a91e5af7e22 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.291500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1d8b3-ecee-4885-b584-9a91e5af7e22 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.291985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1d8b3-ecee-4885-b584-9a91e5af7e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.310403 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-60e1d8b3-ecee-4885-b584-9a91e5af7e22 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:31.311898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-60e1d8b3-ecee-4885-b584-9a91e5af7e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:31.342036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:31.372493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a841c05-7fed-4b26-81e5-e520c4491204 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.373411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a841c05-7fed-4b26-81e5-e520c4491204 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.373877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a841c05-7fed-4b26-81e5-e520c4491204 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.375879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 72/145] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:31.382524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d76e-e565-4ecf-bf99-ec2b0c4166fa None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.382524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d76e-e565-4ecf-bf99-ec2b0c4166fa None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.382524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d76e-e565-4ecf-bf99-ec2b0c4166fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.384242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 74/146] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:31.400369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-a3f6d76e-e565-4ecf-bf99-ec2b0c4166fa None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:31.401566 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a3f6d76e-e565-4ecf-bf99-ec2b0c4166fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:31.462808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1d8b3-ecee-4885-b584-9a91e5af7e22 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:31.466568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 73/147] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:31.566384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1d8b3-ecee-4885-b584-9a91e5af7e22 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:31.603382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e51e7-381e-432c-9710-bb9b4d945a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:31.604062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e51e7-381e-432c-9710-bb9b4d945a9c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.604342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e51e7-381e-432c-9710-bb9b4d945a9c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.604612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e51e7-381e-432c-9710-bb9b4d945a9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.614701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e51e7-381e-432c-9710-bb9b4d945a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-8b3e51e7-381e-432c-9710-bb9b4d945a9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:31.619890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:31.620702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:31.621465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 75/148] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:31.626773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d76e-e565-4ecf-bf99-ec2b0c4166fa None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:31.657842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e51e7-381e-432c-9710-bb9b4d945a9c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:31.680927 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:31.687567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:31.731625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d76e-e565-4ecf-bf99-ec2b0c4166fa None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:31.762991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e51e7-381e-432c-9710-bb9b4d945a9c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:31.764315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6ab17-8211-430a-9234-efceeb4033df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:31.764927 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6ab17-8211-430a-9234-efceeb4033df None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.765211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6ab17-8211-430a-9234-efceeb4033df None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.765484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6ab17-8211-430a-9234-efceeb4033df None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.766145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6ab17-8211-430a-9234-efceeb4033df None admin] RBAC: Adding query filter params (name=admin) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:31.766446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6ab17-8211-430a-9234-efceeb4033df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:31.767836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6ab17-8211-430a-9234-efceeb4033df None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:31.775968 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 74/149] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:31.776734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6ab17-8211-430a-9234-efceeb4033df None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:31.799400 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f79f-f997-4ecd-aa8f-61c14fcf9af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:31.800062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f79f-f997-4ecd-aa8f-61c14fcf9af0 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.800341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f79f-f997-4ecd-aa8f-61c14fcf9af0 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.800611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f79f-f997-4ecd-aa8f-61c14fcf9af0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.811724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6f79f-f997-4ecd-aa8f-61c14fcf9af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-f4b6f79f-f997-4ecd-aa8f-61c14fcf9af0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:31.816548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:31.817582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 76/150] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:36:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:31.818415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f79f-f997-4ecd-aa8f-61c14fcf9af0 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:31.880329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6ab17-8211-430a-9234-efceeb4033df None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:31.894123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:31.901398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:31.915101 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fe423-47ac-4cb1-87f8-ba00b1d19218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:31.915762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe423-47ac-4cb1-87f8-ba00b1d19218 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.916042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe423-47ac-4cb1-87f8-ba00b1d19218 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.916314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fe423-47ac-4cb1-87f8-ba00b1d19218 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.916719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f79f-f997-4ecd-aa8f-61c14fcf9af0 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:31.917410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fe423-47ac-4cb1-87f8-ba00b1d19218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:31.918843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fe423-47ac-4cb1-87f8-ba00b1d19218 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:31.920419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 75/151] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:31.922256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fe423-47ac-4cb1-87f8-ba00b1d19218 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:31.950900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb8d5-e227-4e9b-8336-7f9f6b6e8e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:31.951565 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb8d5-e227-4e9b-8336-7f9f6b6e8e54 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:31.951850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb8d5-e227-4e9b-8336-7f9f6b6e8e54 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:31.952124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb8d5-e227-4e9b-8336-7f9f6b6e8e54 None admin] PATH_INFO: `/v3/users/f8dd9779b4a74e3c9f63f6eb79ce48c0` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:31.965468 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb8d5-e227-4e9b-8336-7f9f6b6e8e54 None admin] RBAC: Authorizing `identity:get_user(user_id=f8dd9779b4a74e3c9f63f6eb79ce48c0)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:31.967027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb8d5-e227-4e9b-8336-7f9f6b6e8e54 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:31.968536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 77/152] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:31 2022] GET /identity/v3/users/f8dd9779b4a74e3c9f63f6eb79ce48c0 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:31.968536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb8d5-e227-4e9b-8336-7f9f6b6e8e54 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:32.019674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fe423-47ac-4cb1-87f8-ba00b1d19218 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:32.052846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c58e6-ed25-42ee-9fcf-0fbc4d874a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:32.053445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c58e6-ed25-42ee-9fcf-0fbc4d874a5d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:32.053972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c58e6-ed25-42ee-9fcf-0fbc4d874a5d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:32.053972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c58e6-ed25-42ee-9fcf-0fbc4d874a5d None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:32.054636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c58e6-ed25-42ee-9fcf-0fbc4d874a5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:32.054944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c58e6-ed25-42ee-9fcf-0fbc4d874a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:32.056373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c58e6-ed25-42ee-9fcf-0fbc4d874a5d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:32.064230 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 76/153] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:36:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:32.064867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c58e6-ed25-42ee-9fcf-0fbc4d874a5d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:32.068424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb8d5-e227-4e9b-8336-7f9f6b6e8e54 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:32.101751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebf27f-9164-49b0-922b-554ab6bc1c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:32.102359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebf27f-9164-49b0-922b-554ab6bc1c2a None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:32.102641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebf27f-9164-49b0-922b-554ab6bc1c2a None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:32.102917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebf27f-9164-49b0-922b-554ab6bc1c2a None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:32.103590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebf27f-9164-49b0-922b-554ab6bc1c2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:32.105024 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebf27f-9164-49b0-922b-554ab6bc1c2a None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:32.110523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:32.121801 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:32.126846 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 78/154] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:36:31 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:32.127997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebf27f-9164-49b0-922b-554ab6bc1c2a None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:32.186867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c58e6-ed25-42ee-9fcf-0fbc4d874a5d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:32.225711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c81c5-692a-4e6d-aab3-fae6426072ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:32.226365 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c81c5-692a-4e6d-aab3-fae6426072ca None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:32.226825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c81c5-692a-4e6d-aab3-fae6426072ca None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:32.227109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c81c5-692a-4e6d-aab3-fae6426072ca None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:32.228345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c81c5-692a-4e6d-aab3-fae6426072ca None admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:32.229842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c81c5-692a-4e6d-aab3-fae6426072ca None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:32.231742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 77/155] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:32 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:32.237374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c81c5-692a-4e6d-aab3-fae6426072ca None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:32.252489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebf27f-9164-49b0-922b-554ab6bc1c2a None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:32.294338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f544c9-89c3-4d54-85b7-a990234a9fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:32.294992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f544c9-89c3-4d54-85b7-a990234a9fed None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:32.295289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f544c9-89c3-4d54-85b7-a990234a9fed None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:32.295585 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f544c9-89c3-4d54-85b7-a990234a9fed None admin] PATH_INFO: `/v3/users/f8dd9779b4a74e3c9f63f6eb79ce48c0` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:32.297187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f544c9-89c3-4d54-85b7-a990234a9fed None admin] RBAC: Authorizing `identity:get_user(user_id=f8dd9779b4a74e3c9f63f6eb79ce48c0)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:32.298832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f544c9-89c3-4d54-85b7-a990234a9fed None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:32.300570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 79/156] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:32 2022] GET /identity/v3/users/f8dd9779b4a74e3c9f63f6eb79ce48c0 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:32.306536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f544c9-89c3-4d54-85b7-a990234a9fed None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:32.355346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c81c5-692a-4e6d-aab3-fae6426072ca None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:32.371870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:32.393899 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:32.400520 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333439-8f5e-4b21-90cf-9fd26580ee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:32.401190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333439-8f5e-4b21-90cf-9fd26580ee5a None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:32.401470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333439-8f5e-4b21-90cf-9fd26580ee5a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:32.401750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333439-8f5e-4b21-90cf-9fd26580ee5a None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da/users/f8dd9779b4a74e3c9f63f6eb79ce48c0/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:32.404775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6333439-8f5e-4b21-90cf-9fd26580ee5a None admin] RBAC: Authorizing `identity:create_grant(project_id=0d78675626af4bcbbb7d24f4412d93da, user_id=f8dd9779b4a74e3c9f63f6eb79ce48c0, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:32.407152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6333439-8f5e-4b21-90cf-9fd26580ee5a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:32.423111 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 78/157] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:36:32 2022] PUT /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da/users/f8dd9779b4a74e3c9f63f6eb79ce48c0/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:36:32.438435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f544c9-89c3-4d54-85b7-a990234a9fed None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:32.479964 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a05b5e-c974-4c8e-b4ab-a771ff88a37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:32.480685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a05b5e-c974-4c8e-b4ab-a771ff88a37f None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:32.480974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a05b5e-c974-4c8e-b4ab-a771ff88a37f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:32.481255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a05b5e-c974-4c8e-b4ab-a771ff88a37f None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:32.482493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a05b5e-c974-4c8e-b4ab-a771ff88a37f None admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:32.484056 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a05b5e-c974-4c8e-b4ab-a771ff88a37f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:32.486153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 80/158] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:32 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:32.491894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333439-8f5e-4b21-90cf-9fd26580ee5a None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:32.616432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333439-8f5e-4b21-90cf-9fd26580ee5a None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:32.654085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a2298-a589-43b0-b871-23e447c532f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:32.654758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2298-a589-43b0-b871-23e447c532f8 None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:32.655041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2298-a589-43b0-b871-23e447c532f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:32.655380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a2298-a589-43b0-b871-23e447c532f8 None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da/users/f8dd9779b4a74e3c9f63f6eb79ce48c0/roles/50ea03120ffe45e196a21607ebe0cc8a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:32.657589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a2298-a589-43b0-b871-23e447c532f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d78675626af4bcbbb7d24f4412d93da, user_id=f8dd9779b4a74e3c9f63f6eb79ce48c0, role_id=50ea03120ffe45e196a21607ebe0cc8a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:32.659027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a2298-a589-43b0-b871-23e447c532f8 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:32.676219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 79/159] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:36:32 2022] PUT /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da/users/f8dd9779b4a74e3c9f63f6eb79ce48c0/roles/50ea03120ffe45e196a21607ebe0cc8a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:36:34.408245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1db3-3727-4aa2-a44f-a551fc15fab0 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:34.408787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1db3-3727-4aa2-a44f-a551fc15fab0 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:34.408787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1db3-3727-4aa2-a44f-a551fc15fab0 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:34.410304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 81/160] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:34.416036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29e54c-6de2-4787-8a51-e802d91fbacb None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:34.416886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29e54c-6de2-4787-8a51-e802d91fbacb None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:34.417363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29e54c-6de2-4787-8a51-e802d91fbacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:34.436591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-dc29e54c-6de2-4787-8a51-e802d91fbacb None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:34.438210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dc29e54c-6de2-4787-8a51-e802d91fbacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:34.472391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:34.516538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 80/161] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:34.579102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d7931-683c-4266-bbe1-fd475363a127 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:34.579421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d7931-683c-4266-bbe1-fd475363a127 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:34.579704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d7931-683c-4266-bbe1-fd475363a127 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:34.581184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 82/162] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:34.587167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0abf8-05c7-491b-82df-cab11227e88a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:34.587482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0abf8-05c7-491b-82df-cab11227e88a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:34.587762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0abf8-05c7-491b-82df-cab11227e88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:34.607230 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-dcb0abf8-05c7-491b-82df-cab11227e88a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:34.608734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dcb0abf8-05c7-491b-82df-cab11227e88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:34.640833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1761d4-3451-4d00-a3d9-11bc5c1afe0d None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:34.641143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1761d4-3451-4d00-a3d9-11bc5c1afe0d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:34.641429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1761d4-3451-4d00-a3d9-11bc5c1afe0d None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:34.643055 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 83/163] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:36:34.648666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601cd42-36e1-4257-ac2f-ebd6d3ca1fe1 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:34.648958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601cd42-36e1-4257-ac2f-ebd6d3ca1fe1 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:34.649235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601cd42-36e1-4257-ac2f-ebd6d3ca1fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:34.668446 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b601cd42-36e1-4257-ac2f-ebd6d3ca1fe1 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:34.669573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b601cd42-36e1-4257-ac2f-ebd6d3ca1fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:34.694032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 81/164] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:34.743410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 84/165] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:34.814421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0abf8-05c7-491b-82df-cab11227e88a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:34.823185 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412172-9cdc-4e0e-9cc5-830d34e19eb5 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:34.823509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412172-9cdc-4e0e-9cc5-830d34e19eb5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:34.823789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412172-9cdc-4e0e-9cc5-830d34e19eb5 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:34.825264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 85/166] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:36:34.830214 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b720-802a-4e4e-82c1-6f8ee0a042d8 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:34.830499 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b720-802a-4e4e-82c1-6f8ee0a042d8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:34.830775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b720-802a-4e4e-82c1-6f8ee0a042d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:34.849402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8979b720-802a-4e4e-82c1-6f8ee0a042d8 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:34.850585 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8979b720-802a-4e4e-82c1-6f8ee0a042d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:34.916305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0abf8-05c7-491b-82df-cab11227e88a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:34.917904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 86/167] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:34.919181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:34.919304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:34.952000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02685191-05ff-495e-925a-8701707ed86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:34.952545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02685191-05ff-495e-925a-8701707ed86e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:34.952833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02685191-05ff-495e-925a-8701707ed86e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:34.953167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02685191-05ff-495e-925a-8701707ed86e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:34.963707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02685191-05ff-495e-925a-8701707ed86e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-02685191-05ff-495e-925a-8701707ed86e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:34.968894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:34.969832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:34.970603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 82/168] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:34.978687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979b720-802a-4e4e-82c1-6f8ee0a042d8 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:34.984012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02685191-05ff-495e-925a-8701707ed86e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.091461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979b720-802a-4e4e-82c1-6f8ee0a042d8 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.091831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02685191-05ff-495e-925a-8701707ed86e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.124523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09031f64-bba6-4d32-a37a-1bf2bb2853e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:35.125134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09031f64-bba6-4d32-a37a-1bf2bb2853e9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:35.125411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d69aa-f62c-4d48-88e6-2b3986243820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:35.125521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09031f64-bba6-4d32-a37a-1bf2bb2853e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:35.125727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09031f64-bba6-4d32-a37a-1bf2bb2853e9 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:35.126082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d69aa-f62c-4d48-88e6-2b3986243820 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:35.126329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09031f64-bba6-4d32-a37a-1bf2bb2853e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:35.126431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d69aa-f62c-4d48-88e6-2b3986243820 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:35.126625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d69aa-f62c-4d48-88e6-2b3986243820 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:35.126714 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09031f64-bba6-4d32-a37a-1bf2bb2853e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:35.127762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d69aa-f62c-4d48-88e6-2b3986243820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:35.128089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09031f64-bba6-4d32-a37a-1bf2bb2853e9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:35.129204 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d69aa-f62c-4d48-88e6-2b3986243820 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:35.130975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 83/169] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:35.135912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d69aa-f62c-4d48-88e6-2b3986243820 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.136240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 87/170] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:35.136995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09031f64-bba6-4d32-a37a-1bf2bb2853e9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.162561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:35.200423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:35.245602 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09031f64-bba6-4d32-a37a-1bf2bb2853e9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.245842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d69aa-f62c-4d48-88e6-2b3986243820 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.279089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212e951-13d3-4490-9913-e063f65d3cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:35.279467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cd14d-4963-495f-b4d3-33348fec635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:35.279718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212e951-13d3-4490-9913-e063f65d3cfa None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:35.279995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212e951-13d3-4490-9913-e063f65d3cfa None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:35.280082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cd14d-4963-495f-b4d3-33348fec635c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:35.280266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212e951-13d3-4490-9913-e063f65d3cfa None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:35.280361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cd14d-4963-495f-b4d3-33348fec635c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:35.280619 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cd14d-4963-495f-b4d3-33348fec635c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:35.280900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212e951-13d3-4490-9913-e063f65d3cfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:35.282325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212e951-13d3-4490-9913-e063f65d3cfa None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:35.290481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cd14d-4963-495f-b4d3-33348fec635c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-068cd14d-4963-495f-b4d3-33348fec635c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:35.295215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:35.296315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:35.297305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 84/171] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:36:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:35.298183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cd14d-4963-495f-b4d3-33348fec635c None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.319347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 88/172] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:36:35 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:35.319347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212e951-13d3-4490-9913-e063f65d3cfa None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.387206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:35.409330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cd14d-4963-495f-b4d3-33348fec635c None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.425120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212e951-13d3-4490-9913-e063f65d3cfa None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.442541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:35.449343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae304df-3001-4fed-b2f1-1b03f076f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:35.450686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae304df-3001-4fed-b2f1-1b03f076f5f4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:35.451172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae304df-3001-4fed-b2f1-1b03f076f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:35.451615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae304df-3001-4fed-b2f1-1b03f076f5f4 None admin] PATH_INFO: `/v3/users/d1707ee1b11f412bb391cf8d3021d9a7` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:35.466458 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204a133-4d67-4380-9702-a2896ca19c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:35.467106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a133-4d67-4380-9702-a2896ca19c30 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:35.467421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a133-4d67-4380-9702-a2896ca19c30 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:35.467523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae304df-3001-4fed-b2f1-1b03f076f5f4 None admin] RBAC: Authorizing `identity:get_user(user_id=d1707ee1b11f412bb391cf8d3021d9a7)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:35.467696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a133-4d67-4380-9702-a2896ca19c30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:35.469120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae304df-3001-4fed-b2f1-1b03f076f5f4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:35.471022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 85/173] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:35 2022] GET /identity/v3/users/d1707ee1b11f412bb391cf8d3021d9a7 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:35.471781 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae304df-3001-4fed-b2f1-1b03f076f5f4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.484611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204a133-4d67-4380-9702-a2896ca19c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-1204a133-4d67-4380-9702-a2896ca19c30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:35.490033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:35.490886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:35.491738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 89/174] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:36:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:35.492387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204a133-4d67-4380-9702-a2896ca19c30 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.610139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204a133-4d67-4380-9702-a2896ca19c30 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.613022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae304df-3001-4fed-b2f1-1b03f076f5f4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.652915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f6e7d-93a7-4052-b4a7-525a952962b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:35.653559 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f6e7d-93a7-4052-b4a7-525a952962b2 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:35.653962 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f6e7d-93a7-4052-b4a7-525a952962b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:35.654239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f6e7d-93a7-4052-b4a7-525a952962b2 None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:35.656209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f6e7d-93a7-4052-b4a7-525a952962b2 None admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:35.657795 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f6e7d-93a7-4052-b4a7-525a952962b2 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:35.659367 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 90/175] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:35 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:35.659489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f6e7d-93a7-4052-b4a7-525a952962b2 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.667957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae696d-7c0d-4556-95a0-6cb89a696bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:35.668883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae696d-7c0d-4556-95a0-6cb89a696bed None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:35.669369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae696d-7c0d-4556-95a0-6cb89a696bed None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:35.669866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae696d-7c0d-4556-95a0-6cb89a696bed None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:35.671244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae696d-7c0d-4556-95a0-6cb89a696bed None admin] RBAC: Adding query filter params (name=admin) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:35.671545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae696d-7c0d-4556-95a0-6cb89a696bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:35.672931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae696d-7c0d-4556-95a0-6cb89a696bed None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:35.680935 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:35.689040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 86/176] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:35.689675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae696d-7c0d-4556-95a0-6cb89a696bed None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.713017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:35.780231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f6e7d-93a7-4052-b4a7-525a952962b2 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.815157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3caefa-12c8-4731-955e-31c09120b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:35.815807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3caefa-12c8-4731-955e-31c09120b8aa None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:35.816089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3caefa-12c8-4731-955e-31c09120b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:35.816598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3caefa-12c8-4731-955e-31c09120b8aa None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:35.817030 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3caefa-12c8-4731-955e-31c09120b8aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:35.817332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3caefa-12c8-4731-955e-31c09120b8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:35.818767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3caefa-12c8-4731-955e-31c09120b8aa None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:35.820341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae696d-7c0d-4556-95a0-6cb89a696bed None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.827016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 91/177] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:36:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:35.827888 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3caefa-12c8-4731-955e-31c09120b8aa None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.863916 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e6049-9293-420e-bc9e-80081d736d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:35.866347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e6049-9293-420e-bc9e-80081d736d31 None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:35.866875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e6049-9293-420e-bc9e-80081d736d31 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:35.867348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e6049-9293-420e-bc9e-80081d736d31 None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da/users/d1707ee1b11f412bb391cf8d3021d9a7/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:35.869509 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e6049-9293-420e-bc9e-80081d736d31 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d78675626af4bcbbb7d24f4412d93da, user_id=d1707ee1b11f412bb391cf8d3021d9a7, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:35.871686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e6049-9293-420e-bc9e-80081d736d31 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:35.888888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 87/178] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:36:35 2022] PUT /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da/users/d1707ee1b11f412bb391cf8d3021d9a7/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:36:35.890508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e6049-9293-420e-bc9e-80081d736d31 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:35.990401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3caefa-12c8-4731-955e-31c09120b8aa None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:35.992101 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:35.994443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:36.044561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8e4de-52ce-48a3-9eca-0e932d937df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:36.045266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8e4de-52ce-48a3-9eca-0e932d937df9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:36.045552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8e4de-52ce-48a3-9eca-0e932d937df9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:36.045831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8e4de-52ce-48a3-9eca-0e932d937df9 None admin] PATH_INFO: `/v3/users/f8dd9779b4a74e3c9f63f6eb79ce48c0` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:36.047063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8e4de-52ce-48a3-9eca-0e932d937df9 None admin] RBAC: Authorizing `identity:get_user(user_id=f8dd9779b4a74e3c9f63f6eb79ce48c0)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:36.048859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8e4de-52ce-48a3-9eca-0e932d937df9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:36.050732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 92/179] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:35 2022] GET /identity/v3/users/f8dd9779b4a74e3c9f63f6eb79ce48c0 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:36.057823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8e4de-52ce-48a3-9eca-0e932d937df9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:36.085680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e6049-9293-420e-bc9e-80081d736d31 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:36.124463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1631e8-2f2f-442b-b5b4-5189b6754d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:36.125132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1631e8-2f2f-442b-b5b4-5189b6754d23 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:36.125393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1631e8-2f2f-442b-b5b4-5189b6754d23 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:36.125673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1631e8-2f2f-442b-b5b4-5189b6754d23 None admin] PATH_INFO: `/v3/users/f8dd9779b4a74e3c9f63f6eb79ce48c0` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:36.126838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1631e8-2f2f-442b-b5b4-5189b6754d23 None admin] RBAC: Authorizing `identity:get_user(user_id=f8dd9779b4a74e3c9f63f6eb79ce48c0)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:36.128329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1631e8-2f2f-442b-b5b4-5189b6754d23 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:36.130129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 88/180] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:35 2022] GET /identity/v3/users/f8dd9779b4a74e3c9f63f6eb79ce48c0 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:36.135686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1631e8-2f2f-442b-b5b4-5189b6754d23 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:36.246910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1631e8-2f2f-442b-b5b4-5189b6754d23 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:36.259163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8e4de-52ce-48a3-9eca-0e932d937df9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:36.279689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:36.285218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3de32-7a1a-4251-a698-33c1e3058ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:36.285907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3de32-7a1a-4251-a698-33c1e3058ee7 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:36.286836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3de32-7a1a-4251-a698-33c1e3058ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:36.287126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3de32-7a1a-4251-a698-33c1e3058ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:36.359785 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3de32-7a1a-4251-a698-33c1e3058ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:36.361256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3de32-7a1a-4251-a698-33c1e3058ee7 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:36.376105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516c72d-49a6-4660-9402-aea7e8572f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:36.376744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516c72d-49a6-4660-9402-aea7e8572f2c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:36.377027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516c72d-49a6-4660-9402-aea7e8572f2c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:36.377306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516c72d-49a6-4660-9402-aea7e8572f2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:36.470635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 89/181] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 04:36:36.476959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3de32-7a1a-4251-a698-33c1e3058ee7 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:36.495729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:36.515739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:36.546646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516c72d-49a6-4660-9402-aea7e8572f2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:36.555461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516c72d-49a6-4660-9402-aea7e8572f2c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:36.615061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3de32-7a1a-4251-a698-33c1e3058ee7 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:36.650716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26057a36-3551-44cb-919f-1d90802638f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:36.651384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26057a36-3551-44cb-919f-1d90802638f5 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:36.651678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26057a36-3551-44cb-919f-1d90802638f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:36.651954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26057a36-3551-44cb-919f-1d90802638f5 None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:36.653091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26057a36-3551-44cb-919f-1d90802638f5 None admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:36.654533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26057a36-3551-44cb-919f-1d90802638f5 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:36.656277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 90/182] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:36 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:36.663101 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26057a36-3551-44cb-919f-1d90802638f5 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:36.767861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:36.771939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26057a36-3551-44cb-919f-1d90802638f5 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:36.810400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7581-2331-4314-aa97-0b493e34c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:36.811024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7581-2331-4314-aa97-0b493e34c820 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:36.811347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7581-2331-4314-aa97-0b493e34c820 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:36.811635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7581-2331-4314-aa97-0b493e34c820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:36.812486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de7581-2331-4314-aa97-0b493e34c820 None admin] RBAC: Adding query filter params (role.id=50ea03120ffe45e196a21607ebe0cc8a, scope.project.id=0d78675626af4bcbbb7d24f4412d93da, user.id=f8dd9779b4a74e3c9f63f6eb79ce48c0) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:36.813330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de7581-2331-4314-aa97-0b493e34c820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:36.815313 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de7581-2331-4314-aa97-0b493e34c820 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:36.821650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 91/183] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:36:36 2022] GET /identity/v3/role_assignments?user.id=f8dd9779b4a74e3c9f63f6eb79ce48c0&scope.project.id=0d78675626af4bcbbb7d24f4412d93da&role.id=50ea03120ffe45e196a21607ebe0cc8a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:36.870263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 93/184] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 813 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:36.876347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7581-2331-4314-aa97-0b493e34c820 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:36.994879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7581-2331-4314-aa97-0b493e34c820 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:37.033037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ffcaf-5d03-4ea5-8dde-ce4a19ba0170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:37.033603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ffcaf-5d03-4ea5-8dde-ce4a19ba0170 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:37.033891 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ffcaf-5d03-4ea5-8dde-ce4a19ba0170 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:37.034171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ffcaf-5d03-4ea5-8dde-ce4a19ba0170 None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:37.035353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ffcaf-5d03-4ea5-8dde-ce4a19ba0170 None admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:37.037360 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ffcaf-5d03-4ea5-8dde-ce4a19ba0170 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:37.042819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 92/185] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:36 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:37.045410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516c72d-49a6-4660-9402-aea7e8572f2c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:37.117770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:37.150736 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516c72d-49a6-4660-9402-aea7e8572f2c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:37.186605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e2230-aec6-4e4f-855a-372c01ea8dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:37.187220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2230-aec6-4e4f-855a-372c01ea8dd5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:37.187529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2230-aec6-4e4f-855a-372c01ea8dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:37.187805 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2230-aec6-4e4f-855a-372c01ea8dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:37.188653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e2230-aec6-4e4f-855a-372c01ea8dd5 None admin] RBAC: Adding query filter params (role.id=3d2307e73cdb4f6291f9735ac9359702, scope.project.id=0d78675626af4bcbbb7d24f4412d93da, user.id=f8dd9779b4a74e3c9f63f6eb79ce48c0) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:37.188968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e2230-aec6-4e4f-855a-372c01ea8dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:37.190402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e2230-aec6-4e4f-855a-372c01ea8dd5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:37.199788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 94/186] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:36:37 2022] GET /identity/v3/role_assignments?user.id=f8dd9779b4a74e3c9f63f6eb79ce48c0&scope.project.id=0d78675626af4bcbbb7d24f4412d93da&role.id=3d2307e73cdb4f6291f9735ac9359702 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:37.821825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f70460-a065-4b17-b2a5-53839625b29b None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:37.822340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f70460-a065-4b17-b2a5-53839625b29b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:37.822414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f70460-a065-4b17-b2a5-53839625b29b None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:37.823883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 93/187] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:37.829837 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cca8ac-053d-49dc-b812-89228fbb21a3 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:37.830348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cca8ac-053d-49dc-b812-89228fbb21a3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:37.830348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cca8ac-053d-49dc-b812-89228fbb21a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:37.850194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b6cca8ac-053d-49dc-b812-89228fbb21a3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:37.851425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b6cca8ac-053d-49dc-b812-89228fbb21a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:37.918231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 95/188] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:37.935931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded23e2e-14ae-4fd5-bd77-02ec4038f1d6 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:37.936209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded23e2e-14ae-4fd5-bd77-02ec4038f1d6 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:37.936484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded23e2e-14ae-4fd5-bd77-02ec4038f1d6 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:37.937973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 94/189] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:37.943446 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40798075-b3db-4a82-af30-882663d39ed9 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:37.943740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40798075-b3db-4a82-af30-882663d39ed9 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:37.944017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40798075-b3db-4a82-af30-882663d39ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:37.962353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-40798075-b3db-4a82-af30-882663d39ed9 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:37.963565 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-40798075-b3db-4a82-af30-882663d39ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:38.023778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:38.035327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 96/190] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:38.194659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded23e2e-14ae-4fd5-bd77-02ec4038f1d6 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:38.225158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:38.231260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa740-ae53-443d-a6d4-0443a2d010b9 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:38.231825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa740-ae53-443d-a6d4-0443a2d010b9 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:38.232344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa740-ae53-443d-a6d4-0443a2d010b9 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:38.235497 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 97/191] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:38.240222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f564-ad97-4a62-a1d7-aae3a58c7af8 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:38.240515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f564-ad97-4a62-a1d7-aae3a58c7af8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:38.240792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f564-ad97-4a62-a1d7-aae3a58c7af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:38.263902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-0014f564-ad97-4a62-a1d7-aae3a58c7af8 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:38.265346 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0014f564-ad97-4a62-a1d7-aae3a58c7af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:38.302725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded23e2e-14ae-4fd5-bd77-02ec4038f1d6 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:38.336352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 98/192] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:38.337176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f1233-9580-48fa-88a8-3da969a280a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:38.337570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014f564-ad97-4a62-a1d7-aae3a58c7af8 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:38.337804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f1233-9580-48fa-88a8-3da969a280a9 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:38.338081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f1233-9580-48fa-88a8-3da969a280a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:38.338371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f1233-9580-48fa-88a8-3da969a280a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:38.350155 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f1233-9580-48fa-88a8-3da969a280a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-c97f1233-9580-48fa-88a8-3da969a280a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:38.356052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:38.357117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:38.358019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 95/193] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:38.362686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f1233-9580-48fa-88a8-3da969a280a9 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:38.449378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014f564-ad97-4a62-a1d7-aae3a58c7af8 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:38.455452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:38.470332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f1233-9580-48fa-88a8-3da969a280a9 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:38.477545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:38.489002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d5e3-11e3-473f-b3a5-42ae35187f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:38.489679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d5e3-11e3-473f-b3a5-42ae35187f6a None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:38.489965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d5e3-11e3-473f-b3a5-42ae35187f6a None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:38.490245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d5e3-11e3-473f-b3a5-42ae35187f6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:38.491390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1d5e3-11e3-473f-b3a5-42ae35187f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:38.492858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1d5e3-11e3-473f-b3a5-42ae35187f6a None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:38.494584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 99/194] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:38.499916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d5e3-11e3-473f-b3a5-42ae35187f6a None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:38.506263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e07301-94a3-4b33-84b0-ae8caf5e337d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:38.506873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e07301-94a3-4b33-84b0-ae8caf5e337d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:38.507154 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e07301-94a3-4b33-84b0-ae8caf5e337d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:38.507458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e07301-94a3-4b33-84b0-ae8caf5e337d None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:38.508151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e07301-94a3-4b33-84b0-ae8caf5e337d None admin] RBAC: Adding query filter params (name=reader) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:38.508456 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e07301-94a3-4b33-84b0-ae8caf5e337d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:38.509832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e07301-94a3-4b33-84b0-ae8caf5e337d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:38.518517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 96/195] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:38.523989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e07301-94a3-4b33-84b0-ae8caf5e337d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:38.614491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d5e3-11e3-473f-b3a5-42ae35187f6a None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:38.626080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e07301-94a3-4b33-84b0-ae8caf5e337d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:38.647926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd7c29-7f60-4cbb-a80d-978d6e6f494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:38.648538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd7c29-7f60-4cbb-a80d-978d6e6f494b None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:38.648817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd7c29-7f60-4cbb-a80d-978d6e6f494b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:38.649094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd7c29-7f60-4cbb-a80d-978d6e6f494b None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:38.649729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd7c29-7f60-4cbb-a80d-978d6e6f494b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:38.651176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd7c29-7f60-4cbb-a80d-978d6e6f494b None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:38.659073 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd19094-4498-4705-b9e6-ed6be395cd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:38.659809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd19094-4498-4705-b9e6-ed6be395cd97 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:38.660090 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd19094-4498-4705-b9e6-ed6be395cd97 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:38.660372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd19094-4498-4705-b9e6-ed6be395cd97 None admin] PATH_INFO: `/v3/users/f89c35e87bea4641bf09afa95633b4a3` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:38.671866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 100/196] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:36:38 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:36:38.672672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd7c29-7f60-4cbb-a80d-978d6e6f494b None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:38.683019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd19094-4498-4705-b9e6-ed6be395cd97 None admin] RBAC: Authorizing `identity:get_user(user_id=f89c35e87bea4641bf09afa95633b4a3)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:38.685693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd19094-4498-4705-b9e6-ed6be395cd97 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:38.688165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 97/197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:38 2022] GET /identity/v3/users/f89c35e87bea4641bf09afa95633b4a3 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:38.695600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd19094-4498-4705-b9e6-ed6be395cd97 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:38.707632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:38.731510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:38.787105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd7c29-7f60-4cbb-a80d-978d6e6f494b None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:38.823105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd19094-4498-4705-b9e6-ed6be395cd97 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:38.825289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811349b-f63d-4e25-ad91-fb316a2477ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:38.826552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811349b-f63d-4e25-ad91-fb316a2477ea None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:38.826552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811349b-f63d-4e25-ad91-fb316a2477ea None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:38.826552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811349b-f63d-4e25-ad91-fb316a2477ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:38.837978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811349b-f63d-4e25-ad91-fb316a2477ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-f811349b-f63d-4e25-ad91-fb316a2477ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:38.843611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:38.844496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:38.845289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 101/198] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:38.852087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811349b-f63d-4e25-ad91-fb316a2477ea None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:38.869636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5cb02-fad0-4b48-bd41-6d1abc3974c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:38.870437 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5cb02-fad0-4b48-bd41-6d1abc3974c8 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:38.870721 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5cb02-fad0-4b48-bd41-6d1abc3974c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:38.870995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5cb02-fad0-4b48-bd41-6d1abc3974c8 None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:38.872604 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5cb02-fad0-4b48-bd41-6d1abc3974c8 None admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:38.874047 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5cb02-fad0-4b48-bd41-6d1abc3974c8 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:38.875764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 98/199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:38 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:38.881423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5cb02-fad0-4b48-bd41-6d1abc3974c8 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:38.978156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811349b-f63d-4e25-ad91-fb316a2477ea None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:38.980252 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:38.992368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:39.009933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5cb02-fad0-4b48-bd41-6d1abc3974c8 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:39.024872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d48a00-8577-481e-8138-7f644189a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:39.025624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d48a00-8577-481e-8138-7f644189a918 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:39.025981 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d48a00-8577-481e-8138-7f644189a918 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:39.026331 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d48a00-8577-481e-8138-7f644189a918 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:39.027078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d48a00-8577-481e-8138-7f644189a918 None admin] RBAC: Adding query filter params (name=member) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:39.027503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d48a00-8577-481e-8138-7f644189a918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:39.028991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d48a00-8577-481e-8138-7f644189a918 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:39.038419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 102/200] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:39.044591 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d48a00-8577-481e-8138-7f644189a918 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:39.051308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaef6d-e32c-49a3-a681-d256c5ae19ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:39.051308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaef6d-e32c-49a3-a681-d256c5ae19ea None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:39.051308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaef6d-e32c-49a3-a681-d256c5ae19ea None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:39.051308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaef6d-e32c-49a3-a681-d256c5ae19ea None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da/users/f89c35e87bea4641bf09afa95633b4a3/roles/df5b4de3caab4392b267395849fda6b3` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:39.053583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaef6d-e32c-49a3-a681-d256c5ae19ea None admin] RBAC: Authorizing `identity:create_grant(project_id=0d78675626af4bcbbb7d24f4412d93da, user_id=f89c35e87bea4641bf09afa95633b4a3, role_id=df5b4de3caab4392b267395849fda6b3)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:39.055019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaef6d-e32c-49a3-a681-d256c5ae19ea None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:39.071614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 99/201] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:36:38 2022] PUT /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da/users/f89c35e87bea4641bf09afa95633b4a3/roles/df5b4de3caab4392b267395849fda6b3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:36:39.174242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d48a00-8577-481e-8138-7f644189a918 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:39.212427 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399dc71-1258-4447-a9a9-d890d21cdb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:39.213088 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399dc71-1258-4447-a9a9-d890d21cdb9d None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:39.213371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399dc71-1258-4447-a9a9-d890d21cdb9d None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:39.213650 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399dc71-1258-4447-a9a9-d890d21cdb9d None admin] PATH_INFO: `/v3/users/d1707ee1b11f412bb391cf8d3021d9a7` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:39.214835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399dc71-1258-4447-a9a9-d890d21cdb9d None admin] RBAC: Authorizing `identity:get_user(user_id=d1707ee1b11f412bb391cf8d3021d9a7)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:39.216703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399dc71-1258-4447-a9a9-d890d21cdb9d None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:39.218538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 103/202] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:39 2022] GET /identity/v3/users/d1707ee1b11f412bb391cf8d3021d9a7 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:39.224843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaef6d-e32c-49a3-a681-d256c5ae19ea None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:39.336829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaef6d-e32c-49a3-a681-d256c5ae19ea None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:39.373512 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d42aa0-b835-4d42-abc4-700e5081fbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:39.374123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d42aa0-b835-4d42-abc4-700e5081fbb5 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:39.374399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d42aa0-b835-4d42-abc4-700e5081fbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:39.374670 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d42aa0-b835-4d42-abc4-700e5081fbb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:39.378209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:39.449835 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d42aa0-b835-4d42-abc4-700e5081fbb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:39.451575 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d42aa0-b835-4d42-abc4-700e5081fbb5 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:39.562454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 100/203] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:39.568595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399dc71-1258-4447-a9a9-d890d21cdb9d None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:39.619065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:39.679101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399dc71-1258-4447-a9a9-d890d21cdb9d None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:39.715802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826dc13-7ec1-414f-a103-7af6238743b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:39.716045 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826dc13-7ec1-414f-a103-7af6238743b8 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:39.716331 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826dc13-7ec1-414f-a103-7af6238743b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:39.716615 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826dc13-7ec1-414f-a103-7af6238743b8 None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:39.717797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826dc13-7ec1-414f-a103-7af6238743b8 None admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:39.719256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826dc13-7ec1-414f-a103-7af6238743b8 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:39.721222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 104/204] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:39 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:39.727313 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d42aa0-b835-4d42-abc4-700e5081fbb5 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:39.765213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:39.834440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d42aa0-b835-4d42-abc4-700e5081fbb5 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:39.870052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef125ae-337e-4670-9904-1040ac1fabba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:39.870588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef125ae-337e-4670-9904-1040ac1fabba None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:39.870872 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef125ae-337e-4670-9904-1040ac1fabba None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:39.871149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef125ae-337e-4670-9904-1040ac1fabba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:39.871904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef125ae-337e-4670-9904-1040ac1fabba None admin] RBAC: Adding query filter params (role.id=d39456c8f0144ddeba3555d56fc50e3a, scope.project.id=0d78675626af4bcbbb7d24f4412d93da, user.id=d1707ee1b11f412bb391cf8d3021d9a7) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:39.872213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef125ae-337e-4670-9904-1040ac1fabba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:39.873636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef125ae-337e-4670-9904-1040ac1fabba None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:39.879979 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 101/205] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:36:39 2022] GET /identity/v3/role_assignments?user.id=d1707ee1b11f412bb391cf8d3021d9a7&scope.project.id=0d78675626af4bcbbb7d24f4412d93da&role.id=d39456c8f0144ddeba3555d56fc50e3a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:40.997908 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15140d31-a802-43bc-b1a5-c66a30e1cf96 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:40.998423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15140d31-a802-43bc-b1a5-c66a30e1cf96 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:40.998495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15140d31-a802-43bc-b1a5-c66a30e1cf96 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:40.999890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 105/206] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:41.005179 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7ced-9aac-467e-b0db-aec9cfde9dd7 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.005554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7ced-9aac-467e-b0db-aec9cfde9dd7 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.005734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7ced-9aac-467e-b0db-aec9cfde9dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.024321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c100e39-c71d-40cd-864a-2d2cd2358018 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.024611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c100e39-c71d-40cd-864a-2d2cd2358018 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.024890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c100e39-c71d-40cd-864a-2d2cd2358018 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.025459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-493e7ced-9aac-467e-b0db-aec9cfde9dd7 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:41.026366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 106/207] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:36:41.026651 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-493e7ced-9aac-467e-b0db-aec9cfde9dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:41.031240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854727ed-0ffa-4bc1-9439-284e78e60751 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.031557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854727ed-0ffa-4bc1-9439-284e78e60751 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.031833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854727ed-0ffa-4bc1-9439-284e78e60751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.050553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-854727ed-0ffa-4bc1-9439-284e78e60751 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:41.051808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-854727ed-0ffa-4bc1-9439-284e78e60751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:41.096032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 102/208] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:41.123447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 107/209] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:41.333852 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e3700-e31f-4c83-9ba5-9392a4210f03 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.334137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e3700-e31f-4c83-9ba5-9392a4210f03 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.334330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e3700-e31f-4c83-9ba5-9392a4210f03 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.335752 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 103/210] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:41.341263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99c91-8056-48fc-acdc-182e980b7298 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.341554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99c91-8056-48fc-acdc-182e980b7298 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.341830 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99c91-8056-48fc-acdc-182e980b7298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.359822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-abd99c91-8056-48fc-acdc-182e980b7298 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:41.360990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-abd99c91-8056-48fc-acdc-182e980b7298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:41.362705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e3700-e31f-4c83-9ba5-9392a4210f03 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:41.393580 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:41.395705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:41.435341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 108/211] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:41.435341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99c91-8056-48fc-acdc-182e980b7298 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:41.466997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e3700-e31f-4c83-9ba5-9392a4210f03 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:41.502866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ec776-d281-4e3b-b9ac-9d0bd0a6558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:41.503582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ec776-d281-4e3b-b9ac-9d0bd0a6558e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.503856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ec776-d281-4e3b-b9ac-9d0bd0a6558e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.504128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ec776-d281-4e3b-b9ac-9d0bd0a6558e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.515272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ec776-d281-4e3b-b9ac-9d0bd0a6558e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-7c5ec776-d281-4e3b-b9ac-9d0bd0a6558e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:41.520511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:41.521414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:41.522202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 104/212] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:41.527656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ec776-d281-4e3b-b9ac-9d0bd0a6558e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:41.543578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99c91-8056-48fc-acdc-182e980b7298 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:41.584237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf3a82-ba62-42bf-bebc-2404c5cfc268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:41.584813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf3a82-ba62-42bf-bebc-2404c5cfc268 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.585144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf3a82-ba62-42bf-bebc-2404c5cfc268 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.585422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf3a82-ba62-42bf-bebc-2404c5cfc268 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.586552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf3a82-ba62-42bf-bebc-2404c5cfc268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:41.588074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf3a82-ba62-42bf-bebc-2404c5cfc268 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:41.589764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 109/213] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:41.595046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf3a82-ba62-42bf-bebc-2404c5cfc268 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:41.631301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:41.639921 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:41.642390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ec776-d281-4e3b-b9ac-9d0bd0a6558e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:41.679554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db293-9674-4c71-8fd9-08261941aa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:41.680158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db293-9674-4c71-8fd9-08261941aa02 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.680435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db293-9674-4c71-8fd9-08261941aa02 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.680701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db293-9674-4c71-8fd9-08261941aa02 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.681429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db293-9674-4c71-8fd9-08261941aa02 None admin] RBAC: Adding query filter params (name=member) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:41.681657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db293-9674-4c71-8fd9-08261941aa02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:41.683029 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db293-9674-4c71-8fd9-08261941aa02 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:41.696191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 105/214] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:41.697813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db293-9674-4c71-8fd9-08261941aa02 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:41.711601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf3a82-ba62-42bf-bebc-2404c5cfc268 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:41.745270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cd8c-d6a6-4b34-9500-8f7acb0c82c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:41.745875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cd8c-d6a6-4b34-9500-8f7acb0c82c4 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.746154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cd8c-d6a6-4b34-9500-8f7acb0c82c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.746428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cd8c-d6a6-4b34-9500-8f7acb0c82c4 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.747071 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737cd8c-d6a6-4b34-9500-8f7acb0c82c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:41.748537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737cd8c-d6a6-4b34-9500-8f7acb0c82c4 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:41.769193 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 110/215] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:36:41 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:36:41.772220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cd8c-d6a6-4b34-9500-8f7acb0c82c4 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:41.800609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db293-9674-4c71-8fd9-08261941aa02 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:41.840360 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171d995-8454-4ac0-9318-ec87e9e7c9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:41.840826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171d995-8454-4ac0-9318-ec87e9e7c9bc None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.841274 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171d995-8454-4ac0-9318-ec87e9e7c9bc None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.841555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171d995-8454-4ac0-9318-ec87e9e7c9bc None admin] PATH_INFO: `/v3/users/dd095fda7a2e4ade893753693b2e7c14` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.858240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171d995-8454-4ac0-9318-ec87e9e7c9bc None admin] RBAC: Authorizing `identity:get_user(user_id=dd095fda7a2e4ade893753693b2e7c14)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:41.859845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171d995-8454-4ac0-9318-ec87e9e7c9bc None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:41.861768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 106/216] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:41 2022] GET /identity/v3/users/dd095fda7a2e4ade893753693b2e7c14 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:41.867883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171d995-8454-4ac0-9318-ec87e9e7c9bc None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:41.881007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:41.881209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:41.892137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cd8c-d6a6-4b34-9500-8f7acb0c82c4 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:41.931676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf39903-20a4-458f-8bdd-58c15801320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:41.932576 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf39903-20a4-458f-8bdd-58c15801320b None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:41.933081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf39903-20a4-458f-8bdd-58c15801320b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:41.933500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf39903-20a4-458f-8bdd-58c15801320b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:41.945409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf39903-20a4-458f-8bdd-58c15801320b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-bdf39903-20a4-458f-8bdd-58c15801320b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:41.950777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:41.951705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:41.952493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:41.953099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 111/217] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:41.959206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf39903-20a4-458f-8bdd-58c15801320b None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:41.988966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171d995-8454-4ac0-9318-ec87e9e7c9bc None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:42.030629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33ee45-8fd6-49ec-9f58-d501b17dedf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:42.031264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33ee45-8fd6-49ec-9f58-d501b17dedf1 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:42.031530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33ee45-8fd6-49ec-9f58-d501b17dedf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:42.031812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33ee45-8fd6-49ec-9f58-d501b17dedf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:42.034117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33ee45-8fd6-49ec-9f58-d501b17dedf1 None admin] RBAC: Adding query filter params (role.id=d39456c8f0144ddeba3555d56fc50e3a, user.id=dd095fda7a2e4ade893753693b2e7c14, scope.system=all) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:42.034117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33ee45-8fd6-49ec-9f58-d501b17dedf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:42.034312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33ee45-8fd6-49ec-9f58-d501b17dedf1 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:42.042966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 107/218] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Oct 12 04:36:41 2022] GET /identity/v3/role_assignments?user.id=dd095fda7a2e4ade893753693b2e7c14&scope.system=all&role.id=d39456c8f0144ddeba3555d56fc50e3a => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:42.085041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf39903-20a4-458f-8bdd-58c15801320b None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:42.125438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751358b7-1e5b-4979-b221-64865d6b2a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:42.125978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751358b7-1e5b-4979-b221-64865d6b2a2e None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:42.126267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751358b7-1e5b-4979-b221-64865d6b2a2e None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:42.126558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751358b7-1e5b-4979-b221-64865d6b2a2e None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:42.127257 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751358b7-1e5b-4979-b221-64865d6b2a2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:42.127599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751358b7-1e5b-4979-b221-64865d6b2a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:42.129029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751358b7-1e5b-4979-b221-64865d6b2a2e None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:42.141296 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 112/219] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:42.148467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33ee45-8fd6-49ec-9f58-d501b17dedf1 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:42.235949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:42.262794 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33ee45-8fd6-49ec-9f58-d501b17dedf1 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:42.298055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8deaf65-ac89-402e-97da-cd5ba881c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:42.299081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deaf65-ac89-402e-97da-cd5ba881c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:42.299639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deaf65-ac89-402e-97da-cd5ba881c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:42.300127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deaf65-ac89-402e-97da-cd5ba881c0c6 None admin] PATH_INFO: `/v3/users/f89c35e87bea4641bf09afa95633b4a3` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:42.301561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8deaf65-ac89-402e-97da-cd5ba881c0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=f89c35e87bea4641bf09afa95633b4a3)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:42.303321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8deaf65-ac89-402e-97da-cd5ba881c0c6 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:42.305300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 108/220] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:42 2022] GET /identity/v3/users/f89c35e87bea4641bf09afa95633b4a3 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:42.312434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751358b7-1e5b-4979-b221-64865d6b2a2e None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:42.329860 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:42.418951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751358b7-1e5b-4979-b221-64865d6b2a2e None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:42.454265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7278-c64e-4953-ab54-d1de0a4cc444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:42.455239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7278-c64e-4953-ab54-d1de0a4cc444 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:42.455747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7278-c64e-4953-ab54-d1de0a4cc444 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:42.456216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7278-c64e-4953-ab54-d1de0a4cc444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:42.531600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b7278-c64e-4953-ab54-d1de0a4cc444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:42.533108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b7278-c64e-4953-ab54-d1de0a4cc444 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:42.551486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:42.642860 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 113/221] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:42.649125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8deaf65-ac89-402e-97da-cd5ba881c0c6 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:42.756395 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8deaf65-ac89-402e-97da-cd5ba881c0c6 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:42.793779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe814ff7-f100-4081-9758-679d91c906cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:42.794425 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe814ff7-f100-4081-9758-679d91c906cc None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:42.794709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe814ff7-f100-4081-9758-679d91c906cc None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:42.794988 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe814ff7-f100-4081-9758-679d91c906cc None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:42.796168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe814ff7-f100-4081-9758-679d91c906cc None admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:42.797627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe814ff7-f100-4081-9758-679d91c906cc None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:42.799549 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 109/222] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:42 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:42.806188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7278-c64e-4953-ab54-d1de0a4cc444 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:42.910495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7278-c64e-4953-ab54-d1de0a4cc444 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:42.924658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:42.946821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468dbfb-a058-4265-881a-edbfcc7bc8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:42.947484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468dbfb-a058-4265-881a-edbfcc7bc8bc None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:42.947770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468dbfb-a058-4265-881a-edbfcc7bc8bc None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:42.948048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468dbfb-a058-4265-881a-edbfcc7bc8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:42.948790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468dbfb-a058-4265-881a-edbfcc7bc8bc None admin] RBAC: Adding query filter params (role.id=df5b4de3caab4392b267395849fda6b3, scope.project.id=0d78675626af4bcbbb7d24f4412d93da, user.id=f89c35e87bea4641bf09afa95633b4a3) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:42.949101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468dbfb-a058-4265-881a-edbfcc7bc8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:42.950700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468dbfb-a058-4265-881a-edbfcc7bc8bc None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:42.957673 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 114/223] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:36:42 2022] GET /identity/v3/role_assignments?user.id=f89c35e87bea4641bf09afa95633b4a3&scope.project.id=0d78675626af4bcbbb7d24f4412d93da&role.id=df5b4de3caab4392b267395849fda6b3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:44.088654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dfab3-9d67-4ff7-8da4-9fc438b21a90 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.089197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dfab3-9d67-4ff7-8da4-9fc438b21a90 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.089197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dfab3-9d67-4ff7-8da4-9fc438b21a90 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.090844 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 110/224] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:44.096218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24af42-bc66-4cad-b7bb-9a820a205ccc None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.096644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24af42-bc66-4cad-b7bb-9a820a205ccc None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.096810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24af42-bc66-4cad-b7bb-9a820a205ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.116641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2e24af42-bc66-4cad-b7bb-9a820a205ccc None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:44.117865 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2e24af42-bc66-4cad-b7bb-9a820a205ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:44.195322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 115/225] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:44.228972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ebb1-6d90-4bd6-b703-8a1b4cc1dae5 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.229265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ebb1-6d90-4bd6-b703-8a1b4cc1dae5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.229545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ebb1-6d90-4bd6-b703-8a1b4cc1dae5 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.231061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 111/226] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:44.236190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633c10-63cc-4829-a02e-7f1248a39d9e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.236482 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633c10-63cc-4829-a02e-7f1248a39d9e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.236760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633c10-63cc-4829-a02e-7f1248a39d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.255793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8d633c10-63cc-4829-a02e-7f1248a39d9e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:44.256954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8d633c10-63cc-4829-a02e-7f1248a39d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:44.272128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e097b6-2093-47ba-a880-ad86f411ca9c None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.272416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e097b6-2093-47ba-a880-ad86f411ca9c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.272695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e097b6-2093-47ba-a880-ad86f411ca9c None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.274179 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 112/227] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:36:44.278777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87360dda-3339-40c3-8d05-b07ce8062022 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.279065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87360dda-3339-40c3-8d05-b07ce8062022 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.279413 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87360dda-3339-40c3-8d05-b07ce8062022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.297190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-87360dda-3339-40c3-8d05-b07ce8062022 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:44.298370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-87360dda-3339-40c3-8d05-b07ce8062022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:44.302170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:44.328532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 116/228] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:44.371394 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 113/229] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:44.462334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d633c10-63cc-4829-a02e-7f1248a39d9e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:44.502603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:44.565175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d633c10-63cc-4829-a02e-7f1248a39d9e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:44.591519 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87360dda-3339-40c3-8d05-b07ce8062022 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:44.607518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a610-6ab0-46d1-a907-f0e386a33f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:44.608313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a610-6ab0-46d1-a907-f0e386a33f38 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.608596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a610-6ab0-46d1-a907-f0e386a33f38 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.608873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a610-6ab0-46d1-a907-f0e386a33f38 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.619200 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4a610-6ab0-46d1-a907-f0e386a33f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-7ac4a610-6ab0-46d1-a907-f0e386a33f38 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:44.624015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:44.624882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:44.625660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 117/230] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:44.632595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a610-6ab0-46d1-a907-f0e386a33f38 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:44.697264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87360dda-3339-40c3-8d05-b07ce8062022 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:44.726968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:44.731078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae2a60-c520-457b-819d-2f1c9e46635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:44.731304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a610-6ab0-46d1-a907-f0e386a33f38 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:44.731745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae2a60-c520-457b-819d-2f1c9e46635b None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.732031 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae2a60-c520-457b-819d-2f1c9e46635b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.732309 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae2a60-c520-457b-819d-2f1c9e46635b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.739892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:44.742819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae2a60-c520-457b-819d-2f1c9e46635b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-12ae2a60-c520-457b-819d-2f1c9e46635b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:44.747932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:44.748874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:44.749696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 114/231] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:44.750339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae2a60-c520-457b-819d-2f1c9e46635b None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:44.771267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e91c08-cf22-43eb-8ad9-789248046ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:44.771891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e91c08-cf22-43eb-8ad9-789248046ea7 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.772167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e91c08-cf22-43eb-8ad9-789248046ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.772435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e91c08-cf22-43eb-8ad9-789248046ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.773087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e91c08-cf22-43eb-8ad9-789248046ea7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:44.773384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e91c08-cf22-43eb-8ad9-789248046ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:44.774759 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e91c08-cf22-43eb-8ad9-789248046ea7 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:44.782670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 118/232] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:44.783630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e91c08-cf22-43eb-8ad9-789248046ea7 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:44.850930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae2a60-c520-457b-819d-2f1c9e46635b None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:44.879236 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e91c08-cf22-43eb-8ad9-789248046ea7 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:44.883502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab617cab-cd93-4c27-997b-a7cceec83966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:44.884135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab617cab-cd93-4c27-997b-a7cceec83966 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.884421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab617cab-cd93-4c27-997b-a7cceec83966 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.884700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab617cab-cd93-4c27-997b-a7cceec83966 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.885824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab617cab-cd93-4c27-997b-a7cceec83966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:44.887289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab617cab-cd93-4c27-997b-a7cceec83966 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:44.888909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 115/233] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:44.889757 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab617cab-cd93-4c27-997b-a7cceec83966 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:44.914937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783494a-2ddc-4ae8-ac51-93870cfde4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:44.915567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783494a-2ddc-4ae8-ac51-93870cfde4b5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:44.915843 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783494a-2ddc-4ae8-ac51-93870cfde4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:44.916117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783494a-2ddc-4ae8-ac51-93870cfde4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:44.916766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783494a-2ddc-4ae8-ac51-93870cfde4b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:44.917064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783494a-2ddc-4ae8-ac51-93870cfde4b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:44.918412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783494a-2ddc-4ae8-ac51-93870cfde4b5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:44.926074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 119/234] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:44.926852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783494a-2ddc-4ae8-ac51-93870cfde4b5 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:44.950037 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:44.954775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:44.987855 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab617cab-cd93-4c27-997b-a7cceec83966 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:45.021913 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014a94f-2b07-4b15-8d42-ead829adc26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:45.022527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a94f-2b07-4b15-8d42-ead829adc26d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:45.022812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a94f-2b07-4b15-8d42-ead829adc26d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:45.023089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a94f-2b07-4b15-8d42-ead829adc26d None admin] PATH_INFO: `/v3/users/609ffb976730429a816e35280fa6ddc9` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:45.024715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783494a-2ddc-4ae8-ac51-93870cfde4b5 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:45.036141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014a94f-2b07-4b15-8d42-ead829adc26d None admin] RBAC: Authorizing `identity:get_user(user_id=609ffb976730429a816e35280fa6ddc9)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:45.037636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014a94f-2b07-4b15-8d42-ead829adc26d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:45.039312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 116/235] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:44 2022] GET /identity/v3/users/609ffb976730429a816e35280fa6ddc9 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:45.040097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014a94f-2b07-4b15-8d42-ead829adc26d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:45.057847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482396f6-aef8-41ff-a6ef-e0c2a1a3835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:45.058455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482396f6-aef8-41ff-a6ef-e0c2a1a3835a None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:45.058737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482396f6-aef8-41ff-a6ef-e0c2a1a3835a None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:45.059012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482396f6-aef8-41ff-a6ef-e0c2a1a3835a None admin] PATH_INFO: `/v3/groups` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:45.059653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482396f6-aef8-41ff-a6ef-e0c2a1a3835a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:45.061124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482396f6-aef8-41ff-a6ef-e0c2a1a3835a None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:45.076400 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 120/236] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Oct 12 04:36:44 2022] POST /identity/v3/groups => generated 229 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:36:45.084447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482396f6-aef8-41ff-a6ef-e0c2a1a3835a None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:45.154022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014a94f-2b07-4b15-8d42-ead829adc26d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:45.173315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:45.187658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:45.197209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482396f6-aef8-41ff-a6ef-e0c2a1a3835a None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:45.198882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aef87-dc17-43be-abe6-d4f0c205240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:45.199631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aef87-dc17-43be-abe6-d4f0c205240f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:45.199934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aef87-dc17-43be-abe6-d4f0c205240f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:45.200196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aef87-dc17-43be-abe6-d4f0c205240f None admin] PATH_INFO: `/v3/users/dd095fda7a2e4ade893753693b2e7c14` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:45.201423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aef87-dc17-43be-abe6-d4f0c205240f None admin] RBAC: Authorizing `identity:get_user(user_id=dd095fda7a2e4ade893753693b2e7c14)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:45.202901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aef87-dc17-43be-abe6-d4f0c205240f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:45.204649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 117/237] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:45 2022] GET /identity/v3/users/dd095fda7a2e4ade893753693b2e7c14 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:45.212161 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aef87-dc17-43be-abe6-d4f0c205240f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:45.242988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b347a32-7d3e-47fd-aa27-1a1375bf7846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:45.243887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b347a32-7d3e-47fd-aa27-1a1375bf7846 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:45.244349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b347a32-7d3e-47fd-aa27-1a1375bf7846 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:45.244629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b347a32-7d3e-47fd-aa27-1a1375bf7846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:45.245355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b347a32-7d3e-47fd-aa27-1a1375bf7846 None admin] RBAC: Adding query filter params (role.id=df5b4de3caab4392b267395849fda6b3, user.id=609ffb976730429a816e35280fa6ddc9, scope.system=all) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:45.245666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b347a32-7d3e-47fd-aa27-1a1375bf7846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:45.247111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b347a32-7d3e-47fd-aa27-1a1375bf7846 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:45.254447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 121/238] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Oct 12 04:36:45 2022] GET /identity/v3/role_assignments?user.id=609ffb976730429a816e35280fa6ddc9&scope.system=all&role.id=df5b4de3caab4392b267395849fda6b3 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:45.330117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aef87-dc17-43be-abe6-d4f0c205240f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:45.367929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f04a0-1d9d-49cf-a4af-a796a9b1e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:45.368607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f04a0-1d9d-49cf-a4af-a796a9b1e6e5 None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:45.368891 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f04a0-1d9d-49cf-a4af-a796a9b1e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:45.369167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f04a0-1d9d-49cf-a4af-a796a9b1e6e5 None admin] PATH_INFO: `/v3/system/users/dd095fda7a2e4ade893753693b2e7c14/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:45.370644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f04a0-1d9d-49cf-a4af-a796a9b1e6e5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dd095fda7a2e4ade893753693b2e7c14, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:45.372125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f04a0-1d9d-49cf-a4af-a796a9b1e6e5 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:45.382160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 118/239] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Oct 12 04:36:45 2022] PUT /identity/v3/system/users/dd095fda7a2e4ade893753693b2e7c14/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:36:47.269836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a38ec-2bb4-4066-9a51-6060bfc38cc8 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:47.270863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a38ec-2bb4-4066-9a51-6060bfc38cc8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:47.270958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a38ec-2bb4-4066-9a51-6060bfc38cc8 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:47.272385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 122/240] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:47.279308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d81f-7366-41f2-887e-eb34415cec2b None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:47.279822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d81f-7366-41f2-887e-eb34415cec2b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:47.279895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d81f-7366-41f2-887e-eb34415cec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:47.300316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-19c2d81f-7366-41f2-887e-eb34415cec2b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:47.301539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-19c2d81f-7366-41f2-887e-eb34415cec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:47.356903 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:47.372296 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 119/241] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:47.387256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de4eb6-56f8-4965-8902-5bd790957b6e None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:47.387654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de4eb6-56f8-4965-8902-5bd790957b6e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:47.388008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de4eb6-56f8-4965-8902-5bd790957b6e None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:47.389446 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 123/242] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:47.394647 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a9776-beb6-449a-aa96-c698115ef2b3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:47.394934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a9776-beb6-449a-aa96-c698115ef2b3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:47.395212 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a9776-beb6-449a-aa96-c698115ef2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:47.415742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-a55a9776-beb6-449a-aa96-c698115ef2b3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:47.416952 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a55a9776-beb6-449a-aa96-c698115ef2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:47.486438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 120/243] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:47.520884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4725cb-c4fc-41e2-b819-7cf1966d0b56 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:47.521127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4725cb-c4fc-41e2-b819-7cf1966d0b56 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:47.521370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4725cb-c4fc-41e2-b819-7cf1966d0b56 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:47.522891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 124/244] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:47.527824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126f8ed-4b22-4e18-a198-946febf0d760 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:47.528125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126f8ed-4b22-4e18-a198-946febf0d760 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:47.528407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126f8ed-4b22-4e18-a198-946febf0d760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:47.546872 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c126f8ed-4b22-4e18-a198-946febf0d760 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:47.548093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c126f8ed-4b22-4e18-a198-946febf0d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:47.622045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 121/245] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:47.638205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4725cb-c4fc-41e2-b819-7cf1966d0b56 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:47.737598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4725cb-c4fc-41e2-b819-7cf1966d0b56 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:47.756340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126f8ed-4b22-4e18-a198-946febf0d760 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:47.771984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d612c-72e5-40ca-804c-fbd321e3012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:47.772546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d612c-72e5-40ca-804c-fbd321e3012a None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:47.772823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d612c-72e5-40ca-804c-fbd321e3012a None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:47.773095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d612c-72e5-40ca-804c-fbd321e3012a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:47.774178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d612c-72e5-40ca-804c-fbd321e3012a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:47.775644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d612c-72e5-40ca-804c-fbd321e3012a None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:47.777359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 125/246] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:36:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:47.782385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d612c-72e5-40ca-804c-fbd321e3012a None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:47.798225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:47.807787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:47.861735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126f8ed-4b22-4e18-a198-946febf0d760 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:47.890944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d612c-72e5-40ca-804c-fbd321e3012a None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:47.896583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca8604-2f23-48d5-b0d7-97692ab26d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:47.897210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca8604-2f23-48d5-b0d7-97692ab26d07 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:47.897489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca8604-2f23-48d5-b0d7-97692ab26d07 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:47.897760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca8604-2f23-48d5-b0d7-97692ab26d07 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:47.908141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca8604-2f23-48d5-b0d7-97692ab26d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-2aca8604-2f23-48d5-b0d7-97692ab26d07 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:47.913495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:47.914585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 122/247] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:47.915588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca8604-2f23-48d5-b0d7-97692ab26d07 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:47.929870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a74a1-9cd9-48e3-b82c-4d065553ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:47.930477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a74a1-9cd9-48e3-b82c-4d065553ed88 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:47.930758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a74a1-9cd9-48e3-b82c-4d065553ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:47.931026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a74a1-9cd9-48e3-b82c-4d065553ed88 None admin] PATH_INFO: `/v3/groups` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:47.931671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a74a1-9cd9-48e3-b82c-4d065553ed88 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:47.933110 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a74a1-9cd9-48e3-b82c-4d065553ed88 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:47.955496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 126/248] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Oct 12 04:36:47 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:36:47.957362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a74a1-9cd9-48e3-b82c-4d065553ed88 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:48.026129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca8604-2f23-48d5-b0d7-97692ab26d07 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:48.038443 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:48.049908 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:48.069753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc0a67-0a19-4e99-8c4c-9ff3853f057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:48.070498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc0a67-0a19-4e99-8c4c-9ff3853f057c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:48.070788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc0a67-0a19-4e99-8c4c-9ff3853f057c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:48.071067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc0a67-0a19-4e99-8c4c-9ff3853f057c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:48.078224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a74a1-9cd9-48e3-b82c-4d065553ed88 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:48.083834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc0a67-0a19-4e99-8c4c-9ff3853f057c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-fefc0a67-0a19-4e99-8c4c-9ff3853f057c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:48.088788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:48.090173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:48.091151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 123/249] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:48.097727 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc0a67-0a19-4e99-8c4c-9ff3853f057c None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:48.120779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495a08f-ddf3-4fe6-8db1-48f86af70dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:48.121398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495a08f-ddf3-4fe6-8db1-48f86af70dfb None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:48.121685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495a08f-ddf3-4fe6-8db1-48f86af70dfb None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:48.121959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495a08f-ddf3-4fe6-8db1-48f86af70dfb None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:48.122631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495a08f-ddf3-4fe6-8db1-48f86af70dfb None admin] RBAC: Adding query filter params (name=reader) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:48.122929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495a08f-ddf3-4fe6-8db1-48f86af70dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:48.124335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495a08f-ddf3-4fe6-8db1-48f86af70dfb None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:48.133219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 127/250] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:48.139504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495a08f-ddf3-4fe6-8db1-48f86af70dfb None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:48.220344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc0a67-0a19-4e99-8c4c-9ff3853f057c None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:48.270298 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495a08f-ddf3-4fe6-8db1-48f86af70dfb None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:48.276690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76269a10-296e-43cf-a0bf-40b66459ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:48.276690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76269a10-296e-43cf-a0bf-40b66459ca1f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:48.276690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76269a10-296e-43cf-a0bf-40b66459ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:48.276690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76269a10-296e-43cf-a0bf-40b66459ca1f None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:48.277032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76269a10-296e-43cf-a0bf-40b66459ca1f None admin] RBAC: Adding query filter params (name=member) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:48.277032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76269a10-296e-43cf-a0bf-40b66459ca1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:48.277327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76269a10-296e-43cf-a0bf-40b66459ca1f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:48.291707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 124/251] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:48.293305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76269a10-296e-43cf-a0bf-40b66459ca1f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:48.315803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f563f5a-8d8c-4537-9046-fea9ba53cfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:48.316807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563f5a-8d8c-4537-9046-fea9ba53cfc5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:48.317654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563f5a-8d8c-4537-9046-fea9ba53cfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:48.317940 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563f5a-8d8c-4537-9046-fea9ba53cfc5 None admin] PATH_INFO: `/v3/users/609ffb976730429a816e35280fa6ddc9` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:48.319103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f563f5a-8d8c-4537-9046-fea9ba53cfc5 None admin] RBAC: Authorizing `identity:get_user(user_id=609ffb976730429a816e35280fa6ddc9)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:48.320756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f563f5a-8d8c-4537-9046-fea9ba53cfc5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:48.322362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 128/252] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:48 2022] GET /identity/v3/users/609ffb976730429a816e35280fa6ddc9 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:48.328314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f563f5a-8d8c-4537-9046-fea9ba53cfc5 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:48.332401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:48.337882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:48.439506 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76269a10-296e-43cf-a0bf-40b66459ca1f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:48.469646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f563f5a-8d8c-4537-9046-fea9ba53cfc5 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:48.486634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d04c7-2fcf-49f0-8aa0-7937d3047dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:48.487320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d04c7-2fcf-49f0-8aa0-7937d3047dc6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:48.487607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d04c7-2fcf-49f0-8aa0-7937d3047dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:48.487884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d04c7-2fcf-49f0-8aa0-7937d3047dc6 None admin] PATH_INFO: `/v3/users/dd095fda7a2e4ade893753693b2e7c14` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:48.489170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d04c7-2fcf-49f0-8aa0-7937d3047dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=dd095fda7a2e4ade893753693b2e7c14)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:48.490738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d04c7-2fcf-49f0-8aa0-7937d3047dc6 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:48.492823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 125/253] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:48 2022] GET /identity/v3/users/dd095fda7a2e4ade893753693b2e7c14 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:48.504409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d04c7-2fcf-49f0-8aa0-7937d3047dc6 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:48.519653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7cb2-5083-4f32-81b9-3e7ce1fcfaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:48.520719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7cb2-5083-4f32-81b9-3e7ce1fcfaf9 None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:48.521147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7cb2-5083-4f32-81b9-3e7ce1fcfaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:48.522004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7cb2-5083-4f32-81b9-3e7ce1fcfaf9 None admin] PATH_INFO: `/v3/system/users/609ffb976730429a816e35280fa6ddc9/roles/df5b4de3caab4392b267395849fda6b3` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:48.524011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7cb2-5083-4f32-81b9-3e7ce1fcfaf9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=609ffb976730429a816e35280fa6ddc9, role_id=df5b4de3caab4392b267395849fda6b3)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:48.525843 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7cb2-5083-4f32-81b9-3e7ce1fcfaf9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:48.540717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 129/254] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Oct 12 04:36:48 2022] PUT /identity/v3/system/users/609ffb976730429a816e35280fa6ddc9/roles/df5b4de3caab4392b267395849fda6b3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:36:48.634429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:48.638618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d04c7-2fcf-49f0-8aa0-7937d3047dc6 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:48.678284 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0519b-fddb-441a-a768-8257f176fa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:48.678915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0519b-fddb-441a-a768-8257f176fa84 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:48.679199 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0519b-fddb-441a-a768-8257f176fa84 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:48.679505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0519b-fddb-441a-a768-8257f176fa84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:48.680243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0519b-fddb-441a-a768-8257f176fa84 None admin] RBAC: Adding query filter params (role.id=d39456c8f0144ddeba3555d56fc50e3a, user.id=dd095fda7a2e4ade893753693b2e7c14, scope.system=all) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:48.680554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0519b-fddb-441a-a768-8257f176fa84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:48.682022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0519b-fddb-441a-a768-8257f176fa84 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:48.696354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 126/255] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Oct 12 04:36:48 2022] GET /identity/v3/role_assignments?user.id=dd095fda7a2e4ade893753693b2e7c14&scope.system=all&role.id=d39456c8f0144ddeba3555d56fc50e3a => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:50.524629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cb32e-3570-4f41-b385-fbc7fe56589e None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:50.525150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cb32e-3570-4f41-b385-fbc7fe56589e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:50.525254 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cb32e-3570-4f41-b385-fbc7fe56589e None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:50.526875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 130/256] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:50.532060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9731b-e563-41c2-a695-956fafaf7c2d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:50.532874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9731b-e563-41c2-a695-956fafaf7c2d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:50.533341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9731b-e563-41c2-a695-956fafaf7c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:50.564337 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-abc9731b-e563-41c2-a695-956fafaf7c2d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:50.565865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-abc9731b-e563-41c2-a695-956fafaf7c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:50.653024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 127/257] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 04:36:50.835326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e2eb0-1b4f-44fd-acfe-acca1781eafc None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:50.835661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e2eb0-1b4f-44fd-acfe-acca1781eafc None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:50.835849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e2eb0-1b4f-44fd-acfe-acca1781eafc None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:50.837450 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 131/258] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:50.848620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2b355-2119-481e-ac69-0dcef21edbbe None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:50.849162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2b355-2119-481e-ac69-0dcef21edbbe None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:50.849639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2b355-2119-481e-ac69-0dcef21edbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:50.876244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-dfd2b355-2119-481e-ac69-0dcef21edbbe None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:50.877769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dfd2b355-2119-481e-ac69-0dcef21edbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:50.885782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 128/259] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 04:36:51.101699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc1dfe-8874-469c-bf40-e952d0eed0d3 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.102344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc1dfe-8874-469c-bf40-e952d0eed0d3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.102842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc1dfe-8874-469c-bf40-e952d0eed0d3 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.104680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 132/260] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:51.121189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177126-f0ce-4e3c-abcd-59c1d7b66f30 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.121768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177126-f0ce-4e3c-abcd-59c1d7b66f30 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.122237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c177126-f0ce-4e3c-abcd-59c1d7b66f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.143321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6c177126-f0ce-4e3c-abcd-59c1d7b66f30 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:51.144735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc1dfe-8874-469c-bf40-e952d0eed0d3 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.155643 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6c177126-f0ce-4e3c-abcd-59c1d7b66f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:51.160541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc1dfe-8874-469c-bf40-e952d0eed0d3 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.170637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068771d-f3ec-4293-aa1c-ad27930e2f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.171998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068771d-f3ec-4293-aa1c-ad27930e2f60 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.173345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 129/261] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 04:36:51.173777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068771d-f3ec-4293-aa1c-ad27930e2f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.174193 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068771d-f3ec-4293-aa1c-ad27930e2f60 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.188903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068771d-f3ec-4293-aa1c-ad27930e2f60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-e068771d-f3ec-4293-aa1c-ad27930e2f60 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:51.194000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:51.195016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:51.196042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:51.197907 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 133/262] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:51.203930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c177126-f0ce-4e3c-abcd-59c1d7b66f30 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.216517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c177126-f0ce-4e3c-abcd-59c1d7b66f30 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.224336 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500da7f-c80c-488f-9dbd-a6e07a6e3197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.224954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500da7f-c80c-488f-9dbd-a6e07a6e3197 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.225236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500da7f-c80c-488f-9dbd-a6e07a6e3197 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.225513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500da7f-c80c-488f-9dbd-a6e07a6e3197 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.226181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500da7f-c80c-488f-9dbd-a6e07a6e3197 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:51.226490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500da7f-c80c-488f-9dbd-a6e07a6e3197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.228258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WARNING py.warnings [None req-2500da7f-c80c-488f-9dbd-a6e07a6e3197 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:36:51.228258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: warnings.warn(msg) Oct 12 04:36:51.228258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: Oct 12 04:36:51.229171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500da7f-c80c-488f-9dbd-a6e07a6e3197 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:51.238075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 130/263] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:51.243874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068771d-f3ec-4293-aa1c-ad27930e2f60 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.256837 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068771d-f3ec-4293-aa1c-ad27930e2f60 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.262766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb47703-a6ec-4f18-b652-d7dfdba8be09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.263450 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb47703-a6ec-4f18-b652-d7dfdba8be09 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.263728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb47703-a6ec-4f18-b652-d7dfdba8be09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.263997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb47703-a6ec-4f18-b652-d7dfdba8be09 admin admin] PATH_INFO: `/v3/groups/b24f8b7e1e4e4462906ed4c7474210af` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.271076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb47703-a6ec-4f18-b652-d7dfdba8be09 admin admin] RBAC: Authorizing `identity:get_group(group_id=b24f8b7e1e4e4462906ed4c7474210af)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.272876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WARNING py.warnings [None req-adb47703-a6ec-4f18-b652-d7dfdba8be09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:36:51.272876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: warnings.warn(msg) Oct 12 04:36:51.272876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: Oct 12 04:36:51.274105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb47703-a6ec-4f18-b652-d7dfdba8be09 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:51.275762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 134/264] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/groups/b24f8b7e1e4e4462906ed4c7474210af => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:51.280391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500da7f-c80c-488f-9dbd-a6e07a6e3197 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.287787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb47703-a6ec-4f18-b652-d7dfdba8be09 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.299821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500da7f-c80c-488f-9dbd-a6e07a6e3197 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.300739 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb47703-a6ec-4f18-b652-d7dfdba8be09 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.309412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae710c73-33e8-4c54-81c8-b3b56de497b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.310121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae710c73-33e8-4c54-81c8-b3b56de497b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.310403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae710c73-33e8-4c54-81c8-b3b56de497b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.310676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae710c73-33e8-4c54-81c8-b3b56de497b8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.316443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6212cad-156f-46c5-a9b8-a68cb33e80e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.317846 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6212cad-156f-46c5-a9b8-a68cb33e80e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.318595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6212cad-156f-46c5-a9b8-a68cb33e80e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.319062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6212cad-156f-46c5-a9b8-a68cb33e80e8 admin admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.324397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6212cad-156f-46c5-a9b8-a68cb33e80e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.327332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6212cad-156f-46c5-a9b8-a68cb33e80e8 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:51.329672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 135/265] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:51.335528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6212cad-156f-46c5-a9b8-a68cb33e80e8 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.343307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae710c73-33e8-4c54-81c8-b3b56de497b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:51.349035 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6212cad-156f-46c5-a9b8-a68cb33e80e8 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-ae710c73-33e8-4c54-81c8-b3b56de497b8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:51.349381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:51.350237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:51.351011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 131/266] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:51.358275 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae710c73-33e8-4c54-81c8-b3b56de497b8 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.364039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d8be-31a8-461c-ba3d-7b360b24917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.364985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d8be-31a8-461c-ba3d-7b360b24917c admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.365478 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d8be-31a8-461c-ba3d-7b360b24917c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.365945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d8be-31a8-461c-ba3d-7b360b24917c admin admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8/groups/b24f8b7e1e4e4462906ed4c7474210af/roles/50ea03120ffe45e196a21607ebe0cc8a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.368380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4d8be-31a8-461c-ba3d-7b360b24917c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e783a7bd858944dabed6fde83e3328e8, group_id=b24f8b7e1e4e4462906ed4c7474210af, role_id=50ea03120ffe45e196a21607ebe0cc8a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.369619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WARNING py.warnings [None req-dcc4d8be-31a8-461c-ba3d-7b360b24917c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:36:51.369619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: warnings.warn(msg) Oct 12 04:36:51.369619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: Oct 12 04:36:51.371929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4d8be-31a8-461c-ba3d-7b360b24917c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:51.373555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae710c73-33e8-4c54-81c8-b3b56de497b8 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.383937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7166e6-2226-4de8-9461-02bebcc43776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.384558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7166e6-2226-4de8-9461-02bebcc43776 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.384836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7166e6-2226-4de8-9461-02bebcc43776 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.385106 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7166e6-2226-4de8-9461-02bebcc43776 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.385777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7166e6-2226-4de8-9461-02bebcc43776 admin admin] RBAC: Adding query filter params (name=member) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:51.386075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7166e6-2226-4de8-9461-02bebcc43776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.387722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7166e6-2226-4de8-9461-02bebcc43776 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:51.401420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 136/267] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Oct 12 04:36:51 2022] PUT /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8/groups/b24f8b7e1e4e4462906ed4c7474210af/roles/50ea03120ffe45e196a21607ebe0cc8a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:36:51.402676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 132/268] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:51.408516 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d8be-31a8-461c-ba3d-7b360b24917c admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.468787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:51.501488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d8be-31a8-461c-ba3d-7b360b24917c admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.509518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae893c7-3b2f-44a8-8773-6ff2271f553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.510571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae893c7-3b2f-44a8-8773-6ff2271f553f admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.511062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae893c7-3b2f-44a8-8773-6ff2271f553f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.511564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae893c7-3b2f-44a8-8773-6ff2271f553f admin admin] PATH_INFO: `/v3/groups/b24f8b7e1e4e4462906ed4c7474210af` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.513049 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae893c7-3b2f-44a8-8773-6ff2271f553f admin admin] RBAC: Authorizing `identity:get_group(group_id=b24f8b7e1e4e4462906ed4c7474210af)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.515307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae893c7-3b2f-44a8-8773-6ff2271f553f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:51.517258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 137/269] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/groups/b24f8b7e1e4e4462906ed4c7474210af => generated 226 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:51.523664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7166e6-2226-4de8-9461-02bebcc43776 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.534460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7166e6-2226-4de8-9461-02bebcc43776 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.540690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c22d3-b712-4a12-a96b-70af235b300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.541701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c22d3-b712-4a12-a96b-70af235b300b admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.542174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c22d3-b712-4a12-a96b-70af235b300b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.542641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c22d3-b712-4a12-a96b-70af235b300b admin admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.544255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c22d3-b712-4a12-a96b-70af235b300b admin admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.546690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c22d3-b712-4a12-a96b-70af235b300b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:51.549017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 133/270] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:51.555243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae893c7-3b2f-44a8-8773-6ff2271f553f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.568965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae893c7-3b2f-44a8-8773-6ff2271f553f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.576763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c82eb-cdc7-4b93-95ac-6b3528c5c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.578128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c82eb-cdc7-4b93-95ac-6b3528c5c280 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.578128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c82eb-cdc7-4b93-95ac-6b3528c5c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.578385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c82eb-cdc7-4b93-95ac-6b3528c5c280 admin admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8/groups/b24f8b7e1e4e4462906ed4c7474210af/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.584810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c82eb-cdc7-4b93-95ac-6b3528c5c280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e783a7bd858944dabed6fde83e3328e8, group_id=b24f8b7e1e4e4462906ed4c7474210af, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.587713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c82eb-cdc7-4b93-95ac-6b3528c5c280 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:51.609523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 138/271] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Oct 12 04:36:51 2022] PUT /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8/groups/b24f8b7e1e4e4462906ed4c7474210af/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:36:51.687022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0901-8563-4239-85d8-71ec76132399 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.687350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0901-8563-4239-85d8-71ec76132399 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.687592 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0901-8563-4239-85d8-71ec76132399 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.689126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 134/272] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:51.695708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fec8b-79e5-4234-8c7d-f9d5e110ee99 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.695990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fec8b-79e5-4234-8c7d-f9d5e110ee99 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.696261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fec8b-79e5-4234-8c7d-f9d5e110ee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.721034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bd9fec8b-79e5-4234-8c7d-f9d5e110ee99 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:51.725000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bd9fec8b-79e5-4234-8c7d-f9d5e110ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:51.740807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0901-8563-4239-85d8-71ec76132399 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.832458 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 139/273] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:51.864661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0901-8563-4239-85d8-71ec76132399 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.869565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57297f-3908-42a3-a0c9-c3b1af0ba426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.870449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57297f-3908-42a3-a0c9-c3b1af0ba426 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.870921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57297f-3908-42a3-a0c9-c3b1af0ba426 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.871417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57297f-3908-42a3-a0c9-c3b1af0ba426 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.874061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:51.889400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57297f-3908-42a3-a0c9-c3b1af0ba426 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-7d57297f-3908-42a3-a0c9-c3b1af0ba426 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:51.894704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:51.896115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:51.896897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 135/274] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:51.902322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fec8b-79e5-4234-8c7d-f9d5e110ee99 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.916295 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fec8b-79e5-4234-8c7d-f9d5e110ee99 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.925106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0904-2b86-48ce-8d15-8c650b25bb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.925739 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0904-2b86-48ce-8d15-8c650b25bb4f admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.926014 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0904-2b86-48ce-8d15-8c650b25bb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.926288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0904-2b86-48ce-8d15-8c650b25bb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.927513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db0904-2b86-48ce-8d15-8c650b25bb4f admin admin] RBAC: Adding query filter params (name=member) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:51.927812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db0904-2b86-48ce-8d15-8c650b25bb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.928835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WARNING py.warnings [None req-d7db0904-2b86-48ce-8d15-8c650b25bb4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:36:51.928835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: warnings.warn(msg) Oct 12 04:36:51.928835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: Oct 12 04:36:51.929816 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db0904-2b86-48ce-8d15-8c650b25bb4f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:51.939987 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 140/275] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:51.945847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57297f-3908-42a3-a0c9-c3b1af0ba426 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.955841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57297f-3908-42a3-a0c9-c3b1af0ba426 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.962914 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467451a-5836-45c1-954b-0e6c2ff77c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.963589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467451a-5836-45c1-954b-0e6c2ff77c98 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.963866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467451a-5836-45c1-954b-0e6c2ff77c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.964138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467451a-5836-45c1-954b-0e6c2ff77c98 admin admin] PATH_INFO: `/v3/groups/b24f8b7e1e4e4462906ed4c7474210af` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.965529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467451a-5836-45c1-954b-0e6c2ff77c98 admin admin] RBAC: Authorizing `identity:get_group(group_id=b24f8b7e1e4e4462906ed4c7474210af)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.966547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WARNING py.warnings [None req-7467451a-5836-45c1-954b-0e6c2ff77c98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:36:51.966547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: warnings.warn(msg) Oct 12 04:36:51.966547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: Oct 12 04:36:51.967778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467451a-5836-45c1-954b-0e6c2ff77c98 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:51.969349 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 136/276] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/groups/b24f8b7e1e4e4462906ed4c7474210af => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:51.976825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0904-2b86-48ce-8d15-8c650b25bb4f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:51.986785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0904-2b86-48ce-8d15-8c650b25bb4f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:51.995481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00095a6e-81e9-4800-8493-c46acf6754f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:51.996129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00095a6e-81e9-4800-8493-c46acf6754f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:51.996404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00095a6e-81e9-4800-8493-c46acf6754f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:51.996675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00095a6e-81e9-4800-8493-c46acf6754f8 admin admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:51.997798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00095a6e-81e9-4800-8493-c46acf6754f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:51.999899 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00095a6e-81e9-4800-8493-c46acf6754f8 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:52.001530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 141/277] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 04:36:51 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:52.007900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467451a-5836-45c1-954b-0e6c2ff77c98 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:52.018169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467451a-5836-45c1-954b-0e6c2ff77c98 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:52.027334 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25040b0-a20a-4822-bf27-0fb20cca027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:52.028342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25040b0-a20a-4822-bf27-0fb20cca027c admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:52.028818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25040b0-a20a-4822-bf27-0fb20cca027c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:52.029203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25040b0-a20a-4822-bf27-0fb20cca027c admin admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da/groups/b24f8b7e1e4e4462906ed4c7474210af/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:52.037169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25040b0-a20a-4822-bf27-0fb20cca027c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d78675626af4bcbbb7d24f4412d93da, group_id=b24f8b7e1e4e4462906ed4c7474210af, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:52.038241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WARNING py.warnings [None req-c25040b0-a20a-4822-bf27-0fb20cca027c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:36:52.038241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: warnings.warn(msg) Oct 12 04:36:52.038241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: Oct 12 04:36:52.040238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25040b0-a20a-4822-bf27-0fb20cca027c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:52.059056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 137/278] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Oct 12 04:36:52 2022] PUT /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da/groups/b24f8b7e1e4e4462906ed4c7474210af/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:36:52.317909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00095a6e-81e9-4800-8493-c46acf6754f8 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:52.426803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:52.450057 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00095a6e-81e9-4800-8493-c46acf6754f8 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:52.492615 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde66ee9-970a-464f-8b58-43591dbcb328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:52.493250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66ee9-970a-464f-8b58-43591dbcb328 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:52.493528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66ee9-970a-464f-8b58-43591dbcb328 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:52.493803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde66ee9-970a-464f-8b58-43591dbcb328 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:52.505404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde66ee9-970a-464f-8b58-43591dbcb328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-dde66ee9-970a-464f-8b58-43591dbcb328 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:52.510667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:52.511587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:52.512369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 142/279] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:52.513019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39ebe-1914-4622-8c80-bfcac7f8745a None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:52.513570 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39ebe-1914-4622-8c80-bfcac7f8745a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:52.513570 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39ebe-1914-4622-8c80-bfcac7f8745a None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:52.514919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 138/280] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:36:52.519827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde66ee9-970a-464f-8b58-43591dbcb328 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:52.520809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466721fa-6400-4ba4-b925-ddb427053c48 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:52.521094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466721fa-6400-4ba4-b925-ddb427053c48 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:52.521361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466721fa-6400-4ba4-b925-ddb427053c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:52.561589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-466721fa-6400-4ba4-b925-ddb427053c48 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:52.563561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-466721fa-6400-4ba4-b925-ddb427053c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:52.679603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 139/281] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 04:36:52.714073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde66ee9-970a-464f-8b58-43591dbcb328 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:52.768026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ba30c-38aa-45b0-99c2-82d86a88a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:52.768663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ba30c-38aa-45b0-99c2-82d86a88a8ba None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:52.768951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ba30c-38aa-45b0-99c2-82d86a88a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:52.769233 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ba30c-38aa-45b0-99c2-82d86a88a8ba None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:52.769913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ba30c-38aa-45b0-99c2-82d86a88a8ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:52.770308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ba30c-38aa-45b0-99c2-82d86a88a8ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:52.771750 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ba30c-38aa-45b0-99c2-82d86a88a8ba None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:52.781067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 143/282] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:52.787369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466721fa-6400-4ba4-b925-ddb427053c48 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:52.928383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466721fa-6400-4ba4-b925-ddb427053c48 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:52.957115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:52.971908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c7cb-53e1-4c8c-91dc-f0a20ca4c6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:52.972594 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c7cb-53e1-4c8c-91dc-f0a20ca4c6fa None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:52.972875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c7cb-53e1-4c8c-91dc-f0a20ca4c6fa None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:52.973649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c7cb-53e1-4c8c-91dc-f0a20ca4c6fa None admin] PATH_INFO: `/v3/users/609ffb976730429a816e35280fa6ddc9` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:52.976134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c7cb-53e1-4c8c-91dc-f0a20ca4c6fa None admin] RBAC: Authorizing `identity:get_user(user_id=609ffb976730429a816e35280fa6ddc9)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:52.977661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c7cb-53e1-4c8c-91dc-f0a20ca4c6fa None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:52.979789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 140/283] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:36:52 2022] GET /identity/v3/users/609ffb976730429a816e35280fa6ddc9 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:52.986390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ba30c-38aa-45b0-99c2-82d86a88a8ba None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:53.011310 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:53.118670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ba30c-38aa-45b0-99c2-82d86a88a8ba None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:53.161119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645175-94ed-4098-be38-44486b110b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:53.162032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645175-94ed-4098-be38-44486b110b75 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:53.162492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645175-94ed-4098-be38-44486b110b75 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:53.162942 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645175-94ed-4098-be38-44486b110b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:53.163902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645175-94ed-4098-be38-44486b110b75 None admin] RBAC: Adding query filter params (role.id=df5b4de3caab4392b267395849fda6b3, user.id=609ffb976730429a816e35280fa6ddc9, scope.system=all) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:53.164436 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645175-94ed-4098-be38-44486b110b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:53.166096 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645175-94ed-4098-be38-44486b110b75 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:53.183066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 144/284] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Oct 12 04:36:52 2022] GET /identity/v3/role_assignments?user.id=609ffb976730429a816e35280fa6ddc9&scope.system=all&role.id=df5b4de3caab4392b267395849fda6b3 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:53.224018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c7cb-53e1-4c8c-91dc-f0a20ca4c6fa None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:53.240697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c7cb-53e1-4c8c-91dc-f0a20ca4c6fa None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:53.245314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385400d-874e-4c2e-94c5-d24396102f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:53.245951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385400d-874e-4c2e-94c5-d24396102f3f admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:53.246231 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385400d-874e-4c2e-94c5-d24396102f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:53.246501 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385400d-874e-4c2e-94c5-d24396102f3f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:53.265054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385400d-874e-4c2e-94c5-d24396102f3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-6385400d-874e-4c2e-94c5-d24396102f3f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:53.270527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:53.271421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:53.272796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 141/285] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 04:36:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:53.277551 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645175-94ed-4098-be38-44486b110b75 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:53.293566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645175-94ed-4098-be38-44486b110b75 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:53.300044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb820e-bcbc-45e7-ad6a-b8544e1e2875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:53.301057 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb820e-bcbc-45e7-ad6a-b8544e1e2875 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:53.302090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb820e-bcbc-45e7-ad6a-b8544e1e2875 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:53.302587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb820e-bcbc-45e7-ad6a-b8544e1e2875 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:53.303544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb820e-bcbc-45e7-ad6a-b8544e1e2875 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:53.304103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb820e-bcbc-45e7-ad6a-b8544e1e2875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:53.305976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb820e-bcbc-45e7-ad6a-b8544e1e2875 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:53.318907 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 145/286] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Oct 12 04:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:53.325144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385400d-874e-4c2e-94c5-d24396102f3f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:53.346863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385400d-874e-4c2e-94c5-d24396102f3f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:53.355391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff02d7-c910-40cc-bae6-c603f93f5bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:53.356034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff02d7-c910-40cc-bae6-c603f93f5bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:53.356313 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff02d7-c910-40cc-bae6-c603f93f5bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:53.356582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff02d7-c910-40cc-bae6-c603f93f5bb3 admin admin] PATH_INFO: `/v3/groups/b24f8b7e1e4e4462906ed4c7474210af` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:53.364649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff02d7-c910-40cc-bae6-c603f93f5bb3 admin admin] RBAC: Authorizing `identity:get_group(group_id=b24f8b7e1e4e4462906ed4c7474210af)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:53.366599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff02d7-c910-40cc-bae6-c603f93f5bb3 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:53.368288 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 142/287] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Oct 12 04:36:53 2022] GET /identity/v3/groups/b24f8b7e1e4e4462906ed4c7474210af => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:53.374039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb820e-bcbc-45e7-ad6a-b8544e1e2875 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:53.389296 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb820e-bcbc-45e7-ad6a-b8544e1e2875 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:53.397629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ede453-ee80-44d3-9aa5-5b5c96b18111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:53.398684 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ede453-ee80-44d3-9aa5-5b5c96b18111 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:53.399164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ede453-ee80-44d3-9aa5-5b5c96b18111 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:53.399699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ede453-ee80-44d3-9aa5-5b5c96b18111 admin admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:53.404406 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ede453-ee80-44d3-9aa5-5b5c96b18111 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:53.406944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ede453-ee80-44d3-9aa5-5b5c96b18111 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:53.409014 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 146/288] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 04:36:53 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:53.415140 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff02d7-c910-40cc-bae6-c603f93f5bb3 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:53.429461 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff02d7-c910-40cc-bae6-c603f93f5bb3 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:53.439661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eb213-a11d-432b-9b3f-3f380d1210be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:53.440267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb213-a11d-432b-9b3f-3f380d1210be admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:53.440544 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb213-a11d-432b-9b3f-3f380d1210be admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:53.440818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb213-a11d-432b-9b3f-3f380d1210be admin admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da/groups/b24f8b7e1e4e4462906ed4c7474210af/roles/50ea03120ffe45e196a21607ebe0cc8a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:53.449989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eb213-a11d-432b-9b3f-3f380d1210be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d78675626af4bcbbb7d24f4412d93da, group_id=b24f8b7e1e4e4462906ed4c7474210af, role_id=50ea03120ffe45e196a21607ebe0cc8a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:53.452701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eb213-a11d-432b-9b3f-3f380d1210be admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:53.474290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 143/289] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Oct 12 04:36:53 2022] PUT /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da/groups/b24f8b7e1e4e4462906ed4c7474210af/roles/50ea03120ffe45e196a21607ebe0cc8a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:36:53.929315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046dd7-08c9-4437-81e2-61fae4e09b73 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:53.929854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046dd7-08c9-4437-81e2-61fae4e09b73 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:53.929854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046dd7-08c9-4437-81e2-61fae4e09b73 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:53.931376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 147/290] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:53.936775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1d97-aa50-4205-94e7-9f3cf4e9489e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:53.937199 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1d97-aa50-4205-94e7-9f3cf4e9489e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:53.937370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1d97-aa50-4205-94e7-9f3cf4e9489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:53.964287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-a8ed1d97-aa50-4205-94e7-9f3cf4e9489e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:53.965751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a8ed1d97-aa50-4205-94e7-9f3cf4e9489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:54.038259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 144/291] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 04:36:54.565489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51796-c663-4661-a289-4f543d9d83af None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:54.565856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51796-c663-4661-a289-4f543d9d83af None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:54.566051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51796-c663-4661-a289-4f543d9d83af None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:54.567594 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 148/292] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:54.572823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb28c6-df6e-4659-a946-52972fd1fefc None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:54.573113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb28c6-df6e-4659-a946-52972fd1fefc None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:54.573392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb28c6-df6e-4659-a946-52972fd1fefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:54.583182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c51796-c663-4661-a289-4f543d9d83af None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:54.606635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-02bb28c6-df6e-4659-a946-52972fd1fefc None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:54.607854 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-02bb28c6-df6e-4659-a946-52972fd1fefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:54.611424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c51796-c663-4661-a289-4f543d9d83af None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:54.617215 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37148f-3a46-467d-9a42-3f89ba9afc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:54.617849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37148f-3a46-467d-9a42-3f89ba9afc3a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:54.618133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37148f-3a46-467d-9a42-3f89ba9afc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:54.618412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37148f-3a46-467d-9a42-3f89ba9afc3a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:54.642586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37148f-3a46-467d-9a42-3f89ba9afc3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-be37148f-3a46-467d-9a42-3f89ba9afc3a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:54.653980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:54.654886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:54.655720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 149/293] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 04:36:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:54.665256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37148f-3a46-467d-9a42-3f89ba9afc3a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:54.678195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37148f-3a46-467d-9a42-3f89ba9afc3a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:54.686089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141907e-d455-4628-95dc-8b6219b67110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:54.686857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141907e-d455-4628-95dc-8b6219b67110 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:54.687145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141907e-d455-4628-95dc-8b6219b67110 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:54.687457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141907e-d455-4628-95dc-8b6219b67110 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:54.688132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141907e-d455-4628-95dc-8b6219b67110 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:54.688441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141907e-d455-4628-95dc-8b6219b67110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:54.690045 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141907e-d455-4628-95dc-8b6219b67110 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:54.701431 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 150/294] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 04:36:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:54.706948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141907e-d455-4628-95dc-8b6219b67110 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:54.726004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141907e-d455-4628-95dc-8b6219b67110 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:54.736929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ee95a-1d43-4f06-a86c-69205aab8092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:54.737684 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ee95a-1d43-4f06-a86c-69205aab8092 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:54.737971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ee95a-1d43-4f06-a86c-69205aab8092 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:54.738247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ee95a-1d43-4f06-a86c-69205aab8092 admin admin] PATH_INFO: `/v3/groups/d7c988b4c2e040f0877afc06c3892105` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:54.752841 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ee95a-1d43-4f06-a86c-69205aab8092 admin admin] RBAC: Authorizing `identity:get_group(group_id=d7c988b4c2e040f0877afc06c3892105)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:54.753348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 145/295] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:54.756349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ee95a-1d43-4f06-a86c-69205aab8092 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:54.758288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 151/296] 10.222.0.18 () {56 vars in 1201 bytes} [Wed Oct 12 04:36:54 2022] GET /identity/v3/groups/d7c988b4c2e040f0877afc06c3892105 => generated 229 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:54.763817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb28c6-df6e-4659-a946-52972fd1fefc None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:54.776061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb28c6-df6e-4659-a946-52972fd1fefc None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:54.783127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ae989-0f34-4aea-bfd0-124d5f7cd833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:54.784043 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ae989-0f34-4aea-bfd0-124d5f7cd833 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:54.784550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ae989-0f34-4aea-bfd0-124d5f7cd833 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:54.785012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ae989-0f34-4aea-bfd0-124d5f7cd833 admin admin] PATH_INFO: `/v3/projects/aeb630740ccb4099b311e8a52a3b6b07` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:54.786459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ae989-0f34-4aea-bfd0-124d5f7cd833 admin admin] RBAC: Authorizing `identity:get_project(project_id=aeb630740ccb4099b311e8a52a3b6b07)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:54.788595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ae989-0f34-4aea-bfd0-124d5f7cd833 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:54.790523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 146/297] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Oct 12 04:36:54 2022] GET /identity/v3/projects/aeb630740ccb4099b311e8a52a3b6b07 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:54.796350 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ee95a-1d43-4f06-a86c-69205aab8092 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:54.813759 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ee95a-1d43-4f06-a86c-69205aab8092 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:54.818866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acafa8-4005-41a6-abd5-559b8813d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:54.819909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acafa8-4005-41a6-abd5-559b8813d370 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:54.821342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acafa8-4005-41a6-abd5-559b8813d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:54.821808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acafa8-4005-41a6-abd5-559b8813d370 admin admin] PATH_INFO: `/v3/projects/aeb630740ccb4099b311e8a52a3b6b07/groups/d7c988b4c2e040f0877afc06c3892105/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:54.824044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acafa8-4005-41a6-abd5-559b8813d370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb630740ccb4099b311e8a52a3b6b07, group_id=d7c988b4c2e040f0877afc06c3892105, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:54.827244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acafa8-4005-41a6-abd5-559b8813d370 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:54.848788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 152/298] 10.222.0.18 () {58 vars in 1463 bytes} [Wed Oct 12 04:36:54 2022] PUT /identity/v3/projects/aeb630740ccb4099b311e8a52a3b6b07/groups/d7c988b4c2e040f0877afc06c3892105/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:36:55.062607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ae989-0f34-4aea-bfd0-124d5f7cd833 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:55.096969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aedff7-72de-4a31-a8a4-c4fd19a3b80d None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:55.097454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aedff7-72de-4a31-a8a4-c4fd19a3b80d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:55.097454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aedff7-72de-4a31-a8a4-c4fd19a3b80d None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:55.099919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 153/299] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:55.110167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3372be-21a1-4ddf-82b7-585967e7ddcd None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:55.110473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3372be-21a1-4ddf-82b7-585967e7ddcd None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:55.110731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3372be-21a1-4ddf-82b7-585967e7ddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:55.116256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:55.133338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2c3372be-21a1-4ddf-82b7-585967e7ddcd None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:55.134722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2c3372be-21a1-4ddf-82b7-585967e7ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:55.137826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:55.212049 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ae989-0f34-4aea-bfd0-124d5f7cd833 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:55.237428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 154/300] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:55.240009 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d8c4-89d7-41d5-b133-c526da20e14d None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:55.240531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d8c4-89d7-41d5-b133-c526da20e14d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:55.241211 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d8c4-89d7-41d5-b133-c526da20e14d None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:55.247525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 155/301] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:55.249508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c329a-c332-4045-92cf-2ddff63a2ae5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:55.249784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c329a-c332-4045-92cf-2ddff63a2ae5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:55.250050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c329a-c332-4045-92cf-2ddff63a2ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:55.257087 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45639b-d728-4176-8d33-727e64da54fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:55.258977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45639b-d728-4176-8d33-727e64da54fa None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:55.259790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45639b-d728-4176-8d33-727e64da54fa None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:55.260277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45639b-d728-4176-8d33-727e64da54fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:55.268858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-fd8c329a-c332-4045-92cf-2ddff63a2ae5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:55.270324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fd8c329a-c332-4045-92cf-2ddff63a2ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:55.273587 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45639b-d728-4176-8d33-727e64da54fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-ad45639b-d728-4176-8d33-727e64da54fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:55.279264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:55.280173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:55.280955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:55.283652 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 147/302] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:36:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:55.291814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45639b-d728-4176-8d33-727e64da54fa None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:55.395588 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 156/303] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:55.435699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:55.440925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45639b-d728-4176-8d33-727e64da54fa None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:55.484408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e5d1-fc31-4466-97e9-af4c3c5ee483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:55.485140 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e5d1-fc31-4466-97e9-af4c3c5ee483 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:55.485493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e5d1-fc31-4466-97e9-af4c3c5ee483 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:55.485846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e5d1-fc31-4466-97e9-af4c3c5ee483 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:55.486590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552e5d1-fc31-4466-97e9-af4c3c5ee483 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:55.486971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552e5d1-fc31-4466-97e9-af4c3c5ee483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:55.488563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552e5d1-fc31-4466-97e9-af4c3c5ee483 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:55.498095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 148/304] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:36:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:55.504268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c329a-c332-4045-92cf-2ddff63a2ae5 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:55.576867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:55.613134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c329a-c332-4045-92cf-2ddff63a2ae5 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:55.651660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ac6c3-ca34-4ef7-a7ae-fd689475f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:55.652586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac6c3-ca34-4ef7-a7ae-fd689475f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:55.653058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac6c3-ca34-4ef7-a7ae-fd689475f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:55.653516 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac6c3-ca34-4ef7-a7ae-fd689475f1f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:55.661547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e5d1-fc31-4466-97e9-af4c3c5ee483 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:55.776804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ac6c3-ca34-4ef7-a7ae-fd689475f1f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:55.778293 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ac6c3-ca34-4ef7-a7ae-fd689475f1f1 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:55.817483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e5d1-fc31-4466-97e9-af4c3c5ee483 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:55.889762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c76a66-1f56-4402-95cf-4114883fafb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:55.890411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c76a66-1f56-4402-95cf-4114883fafb8 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:55.890695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c76a66-1f56-4402-95cf-4114883fafb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:55.890972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c76a66-1f56-4402-95cf-4114883fafb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:55.905107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:55.911751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c76a66-1f56-4402-95cf-4114883fafb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-f9c76a66-1f56-4402-95cf-4114883fafb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:55.917321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:55.918185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:55.918966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:55.921562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 149/305] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:55.922557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c76a66-1f56-4402-95cf-4114883fafb8 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:55.944268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:55.962854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 157/306] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 04:36:55.964111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ac6c3-ca34-4ef7-a7ae-fd689475f1f1 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:56.045175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c76a66-1f56-4402-95cf-4114883fafb8 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:56.085119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5fa95-1b94-4a0c-87fd-e066b8fa5b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:56.085881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5fa95-1b94-4a0c-87fd-e066b8fa5b02 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:56.086176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5fa95-1b94-4a0c-87fd-e066b8fa5b02 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:56.086451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5fa95-1b94-4a0c-87fd-e066b8fa5b02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:56.090132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ac6c3-ca34-4ef7-a7ae-fd689475f1f1 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:56.097787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5fa95-1b94-4a0c-87fd-e066b8fa5b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-4ae5fa95-1b94-4a0c-87fd-e066b8fa5b02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:56.103233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:56.104152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 150/307] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:56.105148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5fa95-1b94-4a0c-87fd-e066b8fa5b02 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:56.135010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603261c8-d818-48d5-9537-7b3aa5b6c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:56.135693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603261c8-d818-48d5-9537-7b3aa5b6c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:56.135948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603261c8-d818-48d5-9537-7b3aa5b6c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:56.136270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603261c8-d818-48d5-9537-7b3aa5b6c1a2 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:56.137048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603261c8-d818-48d5-9537-7b3aa5b6c1a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:56.137456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603261c8-d818-48d5-9537-7b3aa5b6c1a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:56.139245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603261c8-d818-48d5-9537-7b3aa5b6c1a2 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:56.150370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 158/308] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:56.151133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603261c8-d818-48d5-9537-7b3aa5b6c1a2 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:56.191981 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:56.205655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:56.236048 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5fa95-1b94-4a0c-87fd-e066b8fa5b02 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:56.283640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894f408-a7ba-43cb-9122-3b2e448c4b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:56.284413 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894f408-a7ba-43cb-9122-3b2e448c4b41 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:56.284756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894f408-a7ba-43cb-9122-3b2e448c4b41 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:56.285100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894f408-a7ba-43cb-9122-3b2e448c4b41 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:56.286406 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894f408-a7ba-43cb-9122-3b2e448c4b41 None admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:56.288204 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894f408-a7ba-43cb-9122-3b2e448c4b41 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:56.289781 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 151/309] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:56 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:56.290612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894f408-a7ba-43cb-9122-3b2e448c4b41 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:56.298001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603261c8-d818-48d5-9537-7b3aa5b6c1a2 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:56.345422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05554ce9-155a-4c2d-bb4c-570a3eac3872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:56.346308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05554ce9-155a-4c2d-bb4c-570a3eac3872 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:56.346440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05554ce9-155a-4c2d-bb4c-570a3eac3872 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:56.346790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05554ce9-155a-4c2d-bb4c-570a3eac3872 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:56.347547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05554ce9-155a-4c2d-bb4c-570a3eac3872 None admin] RBAC: Adding query filter params (name=member) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:56.347916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05554ce9-155a-4c2d-bb4c-570a3eac3872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:56.349433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05554ce9-155a-4c2d-bb4c-570a3eac3872 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:56.358939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 159/310] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:36:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:56.359751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05554ce9-155a-4c2d-bb4c-570a3eac3872 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:56.419613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894f408-a7ba-43cb-9122-3b2e448c4b41 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:56.462204 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dcbc7-5b90-4d35-bdf3-b82c1d58704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:56.462825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dcbc7-5b90-4d35-bdf3-b82c1d58704a None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:56.463137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dcbc7-5b90-4d35-bdf3-b82c1d58704a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:56.463446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dcbc7-5b90-4d35-bdf3-b82c1d58704a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:56.482560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:56.493811 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:56.505227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05554ce9-155a-4c2d-bb4c-570a3eac3872 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:56.550802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dcbc7-5b90-4d35-bdf3-b82c1d58704a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:56.551821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd6127-1c42-4f3d-b46e-4e1e3b2c4a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:56.552329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dcbc7-5b90-4d35-bdf3-b82c1d58704a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:56.552493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6127-1c42-4f3d-b46e-4e1e3b2c4a26 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:56.552760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6127-1c42-4f3d-b46e-4e1e3b2c4a26 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:56.553040 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6127-1c42-4f3d-b46e-4e1e3b2c4a26 None admin] PATH_INFO: `/v3/groups/b24f8b7e1e4e4462906ed4c7474210af` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:56.554176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd6127-1c42-4f3d-b46e-4e1e3b2c4a26 None admin] RBAC: Authorizing `identity:get_group(group_id=b24f8b7e1e4e4462906ed4c7474210af)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:56.555656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd6127-1c42-4f3d-b46e-4e1e3b2c4a26 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:56.557367 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 160/311] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Oct 12 04:36:56 2022] GET /identity/v3/groups/b24f8b7e1e4e4462906ed4c7474210af => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:56.558158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd6127-1c42-4f3d-b46e-4e1e3b2c4a26 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:56.698516 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd6127-1c42-4f3d-b46e-4e1e3b2c4a26 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:56.699387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 152/312] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:56.700664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97dfc-e304-4fc9-bdc1-7f3d84573ef0 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:56.700954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97dfc-e304-4fc9-bdc1-7f3d84573ef0 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:56.701227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97dfc-e304-4fc9-bdc1-7f3d84573ef0 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:56.702582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 153/313] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:56.703169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a97dfc-e304-4fc9-bdc1-7f3d84573ef0 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:56.756074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152f0df-6569-480e-b9e3-66414e9b7422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:56.756904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152f0df-6569-480e-b9e3-66414e9b7422 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:56.757338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152f0df-6569-480e-b9e3-66414e9b7422 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:56.757809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152f0df-6569-480e-b9e3-66414e9b7422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:56.768007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:56.800397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:56.839729 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a97dfc-e304-4fc9-bdc1-7f3d84573ef0 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:56.856821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152f0df-6569-480e-b9e3-66414e9b7422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:56.858605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152f0df-6569-480e-b9e3-66414e9b7422 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:56.882329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b7020-140e-4c37-8322-e161a08bf2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:56.882951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b7020-140e-4c37-8322-e161a08bf2ad None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:56.883233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b7020-140e-4c37-8322-e161a08bf2ad None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:56.883543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b7020-140e-4c37-8322-e161a08bf2ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:56.884269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b7020-140e-4c37-8322-e161a08bf2ad None admin] RBAC: Adding query filter params (group.id=b24f8b7e1e4e4462906ed4c7474210af, role.id=50ea03120ffe45e196a21607ebe0cc8a, scope.project.id=e783a7bd858944dabed6fde83e3328e8) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:56.884580 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b7020-140e-4c37-8322-e161a08bf2ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:56.886012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b7020-140e-4c37-8322-e161a08bf2ad None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:56.895895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 154/314] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Oct 12 04:36:56 2022] GET /identity/v3/role_assignments?group.id=b24f8b7e1e4e4462906ed4c7474210af&scope.project.id=e783a7bd858944dabed6fde83e3328e8&role.id=50ea03120ffe45e196a21607ebe0cc8a => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:56.896669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b7020-140e-4c37-8322-e161a08bf2ad None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:56.999876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 161/315] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:57.001604 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa24fd8-d652-467d-a50b-70193641eaf4 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.002122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa24fd8-d652-467d-a50b-70193641eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.002655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa24fd8-d652-467d-a50b-70193641eaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.026685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-cfa24fd8-d652-467d-a50b-70193641eaf4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:57.027869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cfa24fd8-d652-467d-a50b-70193641eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:57.037214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b7020-140e-4c37-8322-e161a08bf2ad None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:57.050737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:57.082959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b72a-bd5b-429a-9882-89ba956fb875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:57.084010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b72a-bd5b-429a-9882-89ba956fb875 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.084516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b72a-bd5b-429a-9882-89ba956fb875 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.085033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b72a-bd5b-429a-9882-89ba956fb875 None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.086788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b72a-bd5b-429a-9882-89ba956fb875 None admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:57.089730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b72a-bd5b-429a-9882-89ba956fb875 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:57.092012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 155/316] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:56 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:57.093022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b72a-bd5b-429a-9882-89ba956fb875 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:57.098206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:57.114728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 162/317] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:36:57.115761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa24fd8-d652-467d-a50b-70193641eaf4 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:57.210483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b72a-bd5b-429a-9882-89ba956fb875 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:57.229997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa24fd8-d652-467d-a50b-70193641eaf4 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:57.252403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec0723-2770-4d9f-b06f-0bc0dc5784c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:57.253386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec0723-2770-4d9f-b06f-0bc0dc5784c6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.254833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec0723-2770-4d9f-b06f-0bc0dc5784c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.255348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec0723-2770-4d9f-b06f-0bc0dc5784c6 None admin] PATH_INFO: `/v3/projects/e783a7bd858944dabed6fde83e3328e8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.256973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec0723-2770-4d9f-b06f-0bc0dc5784c6 None admin] RBAC: Authorizing `identity:get_project(project_id=e783a7bd858944dabed6fde83e3328e8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:57.258741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec0723-2770-4d9f-b06f-0bc0dc5784c6 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:57.261438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 156/318] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:57 2022] GET /identity/v3/projects/e783a7bd858944dabed6fde83e3328e8 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:57.268094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec0723-2770-4d9f-b06f-0bc0dc5784c6 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:57.270192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80715205-145e-4796-8935-3e8f2fd0bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:57.270894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715205-145e-4796-8935-3e8f2fd0bf1b None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.271185 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715205-145e-4796-8935-3e8f2fd0bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.271493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715205-145e-4796-8935-3e8f2fd0bf1b None admin] PATH_INFO: `/v3/groups/b24f8b7e1e4e4462906ed4c7474210af` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.272860 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80715205-145e-4796-8935-3e8f2fd0bf1b None admin] RBAC: Authorizing `identity:get_group(group_id=b24f8b7e1e4e4462906ed4c7474210af)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:57.274515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80715205-145e-4796-8935-3e8f2fd0bf1b None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:57.276156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 163/319] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Oct 12 04:36:57 2022] GET /identity/v3/groups/b24f8b7e1e4e4462906ed4c7474210af => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:57.282133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80715205-145e-4796-8935-3e8f2fd0bf1b None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:57.340684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:57.367398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:57.413113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec0723-2770-4d9f-b06f-0bc0dc5784c6 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:57.416624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80715205-145e-4796-8935-3e8f2fd0bf1b None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:57.464010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac9c5c-e7a7-445c-85e5-1d5b95612cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:57.464677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9c5c-e7a7-445c-85e5-1d5b95612cd2 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.465219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9c5c-e7a7-445c-85e5-1d5b95612cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.465496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9c5c-e7a7-445c-85e5-1d5b95612cd2 None admin] PATH_INFO: `/v3/groups/b24f8b7e1e4e4462906ed4c7474210af` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.466262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3ecbb-9db3-4ec7-ad33-7069ae4e21e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:57.466949 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3ecbb-9db3-4ec7-ad33-7069ae4e21e7 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.467231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3ecbb-9db3-4ec7-ad33-7069ae4e21e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.467945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3ecbb-9db3-4ec7-ad33-7069ae4e21e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.468693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3ecbb-9db3-4ec7-ad33-7069ae4e21e7 None admin] RBAC: Adding query filter params (group.id=b24f8b7e1e4e4462906ed4c7474210af, role.id=d39456c8f0144ddeba3555d56fc50e3a, scope.project.id=0d78675626af4bcbbb7d24f4412d93da) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:57.469036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3ecbb-9db3-4ec7-ad33-7069ae4e21e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:57.470459 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3ecbb-9db3-4ec7-ad33-7069ae4e21e7 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:57.472683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac9c5c-e7a7-445c-85e5-1d5b95612cd2 None admin] RBAC: Authorizing `identity:get_group(group_id=b24f8b7e1e4e4462906ed4c7474210af)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:57.474992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac9c5c-e7a7-445c-85e5-1d5b95612cd2 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:57.477358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 157/320] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Oct 12 04:36:57 2022] GET /identity/v3/groups/b24f8b7e1e4e4462906ed4c7474210af => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:57.479416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 164/321] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Oct 12 04:36:57 2022] GET /identity/v3/role_assignments?group.id=b24f8b7e1e4e4462906ed4c7474210af&scope.project.id=0d78675626af4bcbbb7d24f4412d93da&role.id=d39456c8f0144ddeba3555d56fc50e3a => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:57.483071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac9c5c-e7a7-445c-85e5-1d5b95612cd2 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:57.484602 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3ecbb-9db3-4ec7-ad33-7069ae4e21e7 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:57.616795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac9c5c-e7a7-445c-85e5-1d5b95612cd2 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:57.634058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3ecbb-9db3-4ec7-ad33-7069ae4e21e7 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:57.637600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:57.663806 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:57.667490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70534-fba0-49b2-a4d3-86467438ea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:57.668173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70534-fba0-49b2-a4d3-86467438ea06 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.668460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70534-fba0-49b2-a4d3-86467438ea06 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.668740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70534-fba0-49b2-a4d3-86467438ea06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.671983 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70534-fba0-49b2-a4d3-86467438ea06 None admin] RBAC: Adding query filter params (group.id=b24f8b7e1e4e4462906ed4c7474210af, role.id=d39456c8f0144ddeba3555d56fc50e3a, scope.project.id=e783a7bd858944dabed6fde83e3328e8) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:57.672309 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70534-fba0-49b2-a4d3-86467438ea06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:57.673786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70534-fba0-49b2-a4d3-86467438ea06 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:57.677694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b38d0-c098-47a1-bb4f-e8a85ba4b674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:57.678563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b38d0-c098-47a1-bb4f-e8a85ba4b674 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.679029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b38d0-c098-47a1-bb4f-e8a85ba4b674 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.679515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b38d0-c098-47a1-bb4f-e8a85ba4b674 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.681261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 158/322] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Oct 12 04:36:57 2022] GET /identity/v3/role_assignments?group.id=b24f8b7e1e4e4462906ed4c7474210af&scope.project.id=e783a7bd858944dabed6fde83e3328e8&role.id=d39456c8f0144ddeba3555d56fc50e3a => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:57.683354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08863930-a9c6-45f8-9d7e-ee6e4d99a9ae None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.683648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08863930-a9c6-45f8-9d7e-ee6e4d99a9ae None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.683925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08863930-a9c6-45f8-9d7e-ee6e4d99a9ae None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.685223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 159/323] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:36:57.691123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f9bd6-b738-4c14-9894-4a9799c8b362 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.691492 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f9bd6-b738-4c14-9894-4a9799c8b362 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.691848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f9bd6-b738-4c14-9894-4a9799c8b362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.694079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b38d0-c098-47a1-bb4f-e8a85ba4b674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-bd9b38d0-c098-47a1-bb4f-e8a85ba4b674 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:57.700402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:57.701454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:36:57.702250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:57.704664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 165/324] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:36:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:36:57.710842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b38d0-c098-47a1-bb4f-e8a85ba4b674 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:57.712598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-469f9bd6-b738-4c14-9894-4a9799c8b362 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:36:57.713820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-469f9bd6-b738-4c14-9894-4a9799c8b362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:36:57.806347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 160/325] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:36:57.842821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b38d0-c098-47a1-bb4f-e8a85ba4b674 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:57.888078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d19e5-247f-4dee-b4b8-055283e5f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:57.888717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d19e5-247f-4dee-b4b8-055283e5f6e6 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:57.889003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d19e5-247f-4dee-b4b8-055283e5f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:57.889280 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d19e5-247f-4dee-b4b8-055283e5f6e6 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:57.889966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d19e5-247f-4dee-b4b8-055283e5f6e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:57.890271 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d19e5-247f-4dee-b4b8-055283e5f6e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:57.891686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d19e5-247f-4dee-b4b8-055283e5f6e6 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:57.901198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 166/326] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:36:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:57.906741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f9bd6-b738-4c14-9894-4a9799c8b362 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:58.016525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f9bd6-b738-4c14-9894-4a9799c8b362 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:58.026628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:58.052945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e170c-302d-490f-976a-6485e6dfffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:58.053562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e170c-302d-490f-976a-6485e6dfffd4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:58.053847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e170c-302d-490f-976a-6485e6dfffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:58.054138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e170c-302d-490f-976a-6485e6dfffd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:58.083453 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d19e5-247f-4dee-b4b8-055283e5f6e6 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:58.134865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e170c-302d-490f-976a-6485e6dfffd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:58.136333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e170c-302d-490f-976a-6485e6dfffd4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:58.137681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:58.204327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d19e5-247f-4dee-b4b8-055283e5f6e6 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:58.248766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28438-a10c-4319-91ac-f9d6b981a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:58.251681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28438-a10c-4319-91ac-f9d6b981a39b None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:58.251681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28438-a10c-4319-91ac-f9d6b981a39b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:58.251681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28438-a10c-4319-91ac-f9d6b981a39b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:58.251894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 161/327] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:36:58.256728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e170c-302d-490f-976a-6485e6dfffd4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:58.264389 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f28438-a10c-4319-91ac-f9d6b981a39b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:36:58.268086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-b0f28438-a10c-4319-91ac-f9d6b981a39b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:36:58.269690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:36:58.272988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:36:58.273823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 167/328] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:36:58.277094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28438-a10c-4319-91ac-f9d6b981a39b None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:58.374715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e170c-302d-490f-976a-6485e6dfffd4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:58.394579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28438-a10c-4319-91ac-f9d6b981a39b None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:58.397798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:58.415048 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c0898-3e6c-4b35-b396-46215b9630f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:58.415810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c0898-3e6c-4b35-b396-46215b9630f0 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:58.416152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c0898-3e6c-4b35-b396-46215b9630f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:58.416420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c0898-3e6c-4b35-b396-46215b9630f0 None admin] PATH_INFO: `/v3/projects/0d78675626af4bcbbb7d24f4412d93da` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:58.418175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c0898-3e6c-4b35-b396-46215b9630f0 None admin] RBAC: Authorizing `identity:get_project(project_id=0d78675626af4bcbbb7d24f4412d93da)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:58.419632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c0898-3e6c-4b35-b396-46215b9630f0 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:58.422868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 162/329] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:58 2022] GET /identity/v3/projects/0d78675626af4bcbbb7d24f4412d93da => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:58.427742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c0898-3e6c-4b35-b396-46215b9630f0 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:58.442123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f06a0-facb-46d3-a934-3420eb76aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:58.442738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f06a0-facb-46d3-a934-3420eb76aad6 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:58.443018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f06a0-facb-46d3-a934-3420eb76aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:58.443312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f06a0-facb-46d3-a934-3420eb76aad6 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:58.444003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f06a0-facb-46d3-a934-3420eb76aad6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:58.444300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f06a0-facb-46d3-a934-3420eb76aad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:58.445676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f06a0-facb-46d3-a934-3420eb76aad6 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:58.454221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 168/330] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:58.460564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f06a0-facb-46d3-a934-3420eb76aad6 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:58.523588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:58.546733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c0898-3e6c-4b35-b396-46215b9630f0 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:58.568008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f06a0-facb-46d3-a934-3420eb76aad6 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:58.580372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a897b-3bd5-45ba-a6c2-1e813e8026ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:58.581019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a897b-3bd5-45ba-a6c2-1e813e8026ab None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:58.581302 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a897b-3bd5-45ba-a6c2-1e813e8026ab None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:58.581575 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a897b-3bd5-45ba-a6c2-1e813e8026ab None admin] PATH_INFO: `/v3/groups/b24f8b7e1e4e4462906ed4c7474210af` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:58.583248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a897b-3bd5-45ba-a6c2-1e813e8026ab None admin] RBAC: Authorizing `identity:get_group(group_id=b24f8b7e1e4e4462906ed4c7474210af)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:58.584712 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a897b-3bd5-45ba-a6c2-1e813e8026ab None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:58.586280 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 163/331] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Oct 12 04:36:58 2022] GET /identity/v3/groups/b24f8b7e1e4e4462906ed4c7474210af => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:58.592383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a897b-3bd5-45ba-a6c2-1e813e8026ab None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:58.602061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347dc7f-9eef-4a52-a1bf-bd7ccf2dae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:58.602671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347dc7f-9eef-4a52-a1bf-bd7ccf2dae96 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:58.602951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347dc7f-9eef-4a52-a1bf-bd7ccf2dae96 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:58.603224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347dc7f-9eef-4a52-a1bf-bd7ccf2dae96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:58.635135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:58.669787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347dc7f-9eef-4a52-a1bf-bd7ccf2dae96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:58.671168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347dc7f-9eef-4a52-a1bf-bd7ccf2dae96 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:58.688656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a897b-3bd5-45ba-a6c2-1e813e8026ab None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:58.724081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac5f0d-7417-4ea8-81c9-97e145280e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:58.724683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac5f0d-7417-4ea8-81c9-97e145280e5f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:58.724965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac5f0d-7417-4ea8-81c9-97e145280e5f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:58.725240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac5f0d-7417-4ea8-81c9-97e145280e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:58.725961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac5f0d-7417-4ea8-81c9-97e145280e5f None admin] RBAC: Adding query filter params (group.id=b24f8b7e1e4e4462906ed4c7474210af, role.id=50ea03120ffe45e196a21607ebe0cc8a, scope.project.id=0d78675626af4bcbbb7d24f4412d93da) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:58.726269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac5f0d-7417-4ea8-81c9-97e145280e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:58.728174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac5f0d-7417-4ea8-81c9-97e145280e5f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:58.733764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 164/332] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Oct 12 04:36:58 2022] GET /identity/v3/role_assignments?group.id=b24f8b7e1e4e4462906ed4c7474210af&scope.project.id=0d78675626af4bcbbb7d24f4412d93da&role.id=50ea03120ffe45e196a21607ebe0cc8a => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:36:58.771396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 169/333] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 04:36:58.777376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac5f0d-7417-4ea8-81c9-97e145280e5f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:58.789680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:58.883071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac5f0d-7417-4ea8-81c9-97e145280e5f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:58.917108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb33afc-481c-46b6-9985-c676b7d0ab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:58.917739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb33afc-481c-46b6-9985-c676b7d0ab7c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:58.918021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb33afc-481c-46b6-9985-c676b7d0ab7c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:58.918296 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb33afc-481c-46b6-9985-c676b7d0ab7c None admin] PATH_INFO: `/v3/projects/aeb630740ccb4099b311e8a52a3b6b07` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:58.919453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb33afc-481c-46b6-9985-c676b7d0ab7c None admin] RBAC: Authorizing `identity:get_project(project_id=aeb630740ccb4099b311e8a52a3b6b07)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:58.920939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb33afc-481c-46b6-9985-c676b7d0ab7c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:58.922808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 165/334] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:36:58 2022] GET /identity/v3/projects/aeb630740ccb4099b311e8a52a3b6b07 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:58.928264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347dc7f-9eef-4a52-a1bf-bd7ccf2dae96 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:58.994329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:59.030135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347dc7f-9eef-4a52-a1bf-bd7ccf2dae96 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:59.063626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7ac88-3432-40ec-b5a6-98cd626121e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:59.064258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7ac88-3432-40ec-b5a6-98cd626121e6 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:59.064540 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7ac88-3432-40ec-b5a6-98cd626121e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:59.064817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7ac88-3432-40ec-b5a6-98cd626121e6 None admin] PATH_INFO: `/v3/groups/d7c988b4c2e040f0877afc06c3892105` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:59.065929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7ac88-3432-40ec-b5a6-98cd626121e6 None admin] RBAC: Authorizing `identity:get_group(group_id=d7c988b4c2e040f0877afc06c3892105)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:59.067956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7ac88-3432-40ec-b5a6-98cd626121e6 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:59.069538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 170/335] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Oct 12 04:36:58 2022] GET /identity/v3/groups/d7c988b4c2e040f0877afc06c3892105 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:36:59.075525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb33afc-481c-46b6-9985-c676b7d0ab7c None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:36:59.151097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:36:59.172796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb33afc-481c-46b6-9985-c676b7d0ab7c None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:36:59.205214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eabdf-5a8e-4d2b-b4b9-3a8b1bbfd562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:36:59.205815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eabdf-5a8e-4d2b-b4b9-3a8b1bbfd562 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:36:59.206098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eabdf-5a8e-4d2b-b4b9-3a8b1bbfd562 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:36:59.206376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eabdf-5a8e-4d2b-b4b9-3a8b1bbfd562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:36:59.207092 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eabdf-5a8e-4d2b-b4b9-3a8b1bbfd562 None admin] RBAC: Adding query filter params (group.id=d7c988b4c2e040f0877afc06c3892105, role.id=3d2307e73cdb4f6291f9735ac9359702, scope.project.id=aeb630740ccb4099b311e8a52a3b6b07) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:36:59.207452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eabdf-5a8e-4d2b-b4b9-3a8b1bbfd562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:36:59.208864 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eabdf-5a8e-4d2b-b4b9-3a8b1bbfd562 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:36:59.214366 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 166/336] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Oct 12 04:36:59 2022] GET /identity/v3/role_assignments?group.id=d7c988b4c2e040f0877afc06c3892105&scope.project.id=aeb630740ccb4099b311e8a52a3b6b07&role.id=3d2307e73cdb4f6291f9735ac9359702 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:01.866855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91777f5a-1f1e-4ba2-be5c-dc3102cff92f None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:01.867729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91777f5a-1f1e-4ba2-be5c-dc3102cff92f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:01.868153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91777f5a-1f1e-4ba2-be5c-dc3102cff92f None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:01.869900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 171/337] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:01.875672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e796a63-1f6b-4669-b877-18841586debb None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:01.876417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e796a63-1f6b-4669-b877-18841586debb None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:01.876849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e796a63-1f6b-4669-b877-18841586debb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:01.898869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6e796a63-1f6b-4669-b877-18841586debb None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:01.900431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6e796a63-1f6b-4669-b877-18841586debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:01.993543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 167/338] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:37:02.228826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca81a-9383-49c7-adca-91bd250ff816 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:02.229374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca81a-9383-49c7-adca-91bd250ff816 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:02.229796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca81a-9383-49c7-adca-91bd250ff816 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:02.231570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 172/339] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:02.237316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c902af4-5462-47af-8353-b9d520c5838d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:02.237828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c902af4-5462-47af-8353-b9d520c5838d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:02.238302 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c902af4-5462-47af-8353-b9d520c5838d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:02.263012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6c902af4-5462-47af-8353-b9d520c5838d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:02.264550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6c902af4-5462-47af-8353-b9d520c5838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:02.354498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:02.359272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 168/340] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:02.373281 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac1b3-797f-4fcd-95f0-2b1a779aacd5 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:02.373827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac1b3-797f-4fcd-95f0-2b1a779aacd5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:02.374301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac1b3-797f-4fcd-95f0-2b1a779aacd5 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:02.375861 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 173/341] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:02.380830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59c937-bd2e-4599-a1bc-792e25f13389 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:02.381347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59c937-bd2e-4599-a1bc-792e25f13389 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:02.381833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59c937-bd2e-4599-a1bc-792e25f13389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:02.390584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ac1b3-797f-4fcd-95f0-2b1a779aacd5 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:02.405217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-de59c937-bd2e-4599-a1bc-792e25f13389 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:02.406842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-de59c937-bd2e-4599-a1bc-792e25f13389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:02.513375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 169/342] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:02.584573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ac1b3-797f-4fcd-95f0-2b1a779aacd5 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:02.637345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0e159-edde-4243-82c7-60f142ccf424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:02.637978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0e159-edde-4243-82c7-60f142ccf424 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:02.638254 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0e159-edde-4243-82c7-60f142ccf424 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:02.638524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0e159-edde-4243-82c7-60f142ccf424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:02.640506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:02.655032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0e159-edde-4243-82c7-60f142ccf424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:02.655498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149f4a-7596-4842-8c20-55240368c9d9 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:02.655795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149f4a-7596-4842-8c20-55240368c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:02.656079 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149f4a-7596-4842-8c20-55240368c9d9 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:02.656519 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0e159-edde-4243-82c7-60f142ccf424 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:02.657566 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 170/343] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:02.663877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd38b-7c22-4ab1-a3cd-fb6e3595608e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:02.664168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd38b-7c22-4ab1-a3cd-fb6e3595608e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:02.665013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd38b-7c22-4ab1-a3cd-fb6e3595608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-99d0e159-edde-4243-82c7-60f142ccf424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:02.676138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:02.677113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:02.677996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:02.677996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:02.677996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:02.677996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 174/344] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:02.683231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0e159-edde-4243-82c7-60f142ccf424 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:02.684674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-333fd38b-7c22-4ab1-a3cd-fb6e3595608e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:02.685923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-333fd38b-7c22-4ab1-a3cd-fb6e3595608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:02.772648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 171/345] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:37:02.773425 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd38b-7c22-4ab1-a3cd-fb6e3595608e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:02.830755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:02.838195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0e159-edde-4243-82c7-60f142ccf424 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:02.873045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd38b-7c22-4ab1-a3cd-fb6e3595608e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:02.876904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2ca25-e283-435f-b6b4-6295520481b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:02.878075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2ca25-e283-435f-b6b4-6295520481b7 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:02.878568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2ca25-e283-435f-b6b4-6295520481b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:02.879169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2ca25-e283-435f-b6b4-6295520481b7 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:02.880222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2ca25-e283-435f-b6b4-6295520481b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:02.881021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2ca25-e283-435f-b6b4-6295520481b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:02.882890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2ca25-e283-435f-b6b4-6295520481b7 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:02.901810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 175/346] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:02.902956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2ca25-e283-435f-b6b4-6295520481b7 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:02.913248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0abfab-794c-4365-b7f4-628f0e81ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:02.913875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0abfab-794c-4365-b7f4-628f0e81ef33 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:02.914156 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0abfab-794c-4365-b7f4-628f0e81ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:02.914426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0abfab-794c-4365-b7f4-628f0e81ef33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:02.924638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0abfab-794c-4365-b7f4-628f0e81ef33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:02.926672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0abfab-794c-4365-b7f4-628f0e81ef33 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-0d0abfab-794c-4365-b7f4-628f0e81ef33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:02.941223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:02.942201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:02.943089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:02.943089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:02.943089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:02.947259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 172/347] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:02.948222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0abfab-794c-4365-b7f4-628f0e81ef33 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:02.961227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:03.025248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2ca25-e283-435f-b6b4-6295520481b7 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:03.052736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0abfab-794c-4365-b7f4-628f0e81ef33 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:03.063373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e87d60-9b83-4f78-867f-446c202ebd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:03.064306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87d60-9b83-4f78-867f-446c202ebd76 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.064801 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87d60-9b83-4f78-867f-446c202ebd76 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.065317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87d60-9b83-4f78-867f-446c202ebd76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.066144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:03.078586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e87d60-9b83-4f78-867f-446c202ebd76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:03.080620 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e87d60-9b83-4f78-867f-446c202ebd76 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:03.088345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663b6db-b08d-4e54-83c3-e7644ee37000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:03.089277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b6db-b08d-4e54-83c3-e7644ee37000 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.089277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b6db-b08d-4e54-83c3-e7644ee37000 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.089542 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b6db-b08d-4e54-83c3-e7644ee37000 None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.090378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663b6db-b08d-4e54-83c3-e7644ee37000 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:03.091999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663b6db-b08d-4e54-83c3-e7644ee37000 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-d4e87d60-9b83-4f78-867f-446c202ebd76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:03.098532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:03.099449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:03.100300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:03.100300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:03.100300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:03.101823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 176/348] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:03.102832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e87d60-9b83-4f78-867f-446c202ebd76 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:03.120607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 173/349] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:37:02 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:03.121436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663b6db-b08d-4e54-83c3-e7644ee37000 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:03.212589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:03.218324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e87d60-9b83-4f78-867f-446c202ebd76 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:03.230533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663b6db-b08d-4e54-83c3-e7644ee37000 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:03.257095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a610ab-3cb3-4303-92af-ec18c3f7fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:03.257846 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a610ab-3cb3-4303-92af-ec18c3f7fe55 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.258127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a610ab-3cb3-4303-92af-ec18c3f7fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.258400 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a610ab-3cb3-4303-92af-ec18c3f7fe55 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.259052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a610ab-3cb3-4303-92af-ec18c3f7fe55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:03.259384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a610ab-3cb3-4303-92af-ec18c3f7fe55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:03.261083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a610ab-3cb3-4303-92af-ec18c3f7fe55 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:03.268965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0462289-44f5-4de7-a75d-fff85a6c0a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:03.269613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0462289-44f5-4de7-a75d-fff85a6c0a0b None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.269922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0462289-44f5-4de7-a75d-fff85a6c0a0b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.270195 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0462289-44f5-4de7-a75d-fff85a6c0a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.275461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 177/350] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:03.276568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a610ab-3cb3-4303-92af-ec18c3f7fe55 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:03.284760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0462289-44f5-4de7-a75d-fff85a6c0a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:03.286750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0462289-44f5-4de7-a75d-fff85a6c0a0b None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-b0462289-44f5-4de7-a75d-fff85a6c0a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:03.303787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:03.304718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:03.305563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:03.305563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:03.305563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:03.312263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 174/351] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:03.312715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d7ca4-b7bc-4e35-ba53-fa9362379365 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.313006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d7ca4-b7bc-4e35-ba53-fa9362379365 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.313288 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d7ca4-b7bc-4e35-ba53-fa9362379365 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.314599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 175/352] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:03.315470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d7ca4-b7bc-4e35-ba53-fa9362379365 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:03.338778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:03.387732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a610ab-3cb3-4303-92af-ec18c3f7fe55 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:03.422302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6c545-473e-4cd2-99c4-1de2ab901613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:03.422912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6c545-473e-4cd2-99c4-1de2ab901613 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.423189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6c545-473e-4cd2-99c4-1de2ab901613 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.423492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6c545-473e-4cd2-99c4-1de2ab901613 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.424167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6c545-473e-4cd2-99c4-1de2ab901613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:03.424471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6c545-473e-4cd2-99c4-1de2ab901613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:03.425842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6c545-473e-4cd2-99c4-1de2ab901613 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:03.433996 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d7ca4-b7bc-4e35-ba53-fa9362379365 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:03.440853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 178/353] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:03.441707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6c545-473e-4cd2-99c4-1de2ab901613 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:03.460702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:03.479045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312f81a-0a24-4f33-afb2-40acccbe7303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:03.479747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f81a-0a24-4f33-afb2-40acccbe7303 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.479952 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f81a-0a24-4f33-afb2-40acccbe7303 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.480217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f81a-0a24-4f33-afb2-40acccbe7303 None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.480858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312f81a-0a24-4f33-afb2-40acccbe7303 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:03.482278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312f81a-0a24-4f33-afb2-40acccbe7303 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:03.512769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 176/354] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:37:03 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:03.512769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b71c1-5ae1-4589-94c8-64a077b14326 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.512769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b71c1-5ae1-4589-94c8-64a077b14326 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.512769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b71c1-5ae1-4589-94c8-64a077b14326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.528027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-389b71c1-5ae1-4589-94c8-64a077b14326 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:03.529491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-389b71c1-5ae1-4589-94c8-64a077b14326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:03.572590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6c545-473e-4cd2-99c4-1de2ab901613 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:03.616956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2a4e9-54c7-431a-9dae-9102e727ed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:03.617594 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2a4e9-54c7-431a-9dae-9102e727ed03 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.617877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2a4e9-54c7-431a-9dae-9102e727ed03 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.618174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2a4e9-54c7-431a-9dae-9102e727ed03 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.618950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2a4e9-54c7-431a-9dae-9102e727ed03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:03.619346 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2a4e9-54c7-431a-9dae-9102e727ed03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:03.621025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2a4e9-54c7-431a-9dae-9102e727ed03 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:03.631751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 177/355] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:03.634469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 179/356] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:03.640086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b71c1-5ae1-4589-94c8-64a077b14326 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:03.640273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2a4e9-54c7-431a-9dae-9102e727ed03 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:03.653952 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:03.749793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:03.758517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2a4e9-54c7-431a-9dae-9102e727ed03 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:03.776461 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b71c1-5ae1-4589-94c8-64a077b14326 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:03.796550 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258779a-0c37-404f-9147-b6e85675bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:03.797205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258779a-0c37-404f-9147-b6e85675bc5a None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.797497 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258779a-0c37-404f-9147-b6e85675bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.797773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258779a-0c37-404f-9147-b6e85675bc5a None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.798420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258779a-0c37-404f-9147-b6e85675bc5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:03.800034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258779a-0c37-404f-9147-b6e85675bc5a None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:03.811650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534b49-4b57-49d1-8406-0e35b67ca49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:03.812270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534b49-4b57-49d1-8406-0e35b67ca49f None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:03.812613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534b49-4b57-49d1-8406-0e35b67ca49f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:03.812839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534b49-4b57-49d1-8406-0e35b67ca49f None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:03.813468 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534b49-4b57-49d1-8406-0e35b67ca49f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:03.814895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534b49-4b57-49d1-8406-0e35b67ca49f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:03.826106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 180/357] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:37:03 2022] POST /identity/v3/users => generated 249 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:37:03.846171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 178/358] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:37:03 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:03.974794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258779a-0c37-404f-9147-b6e85675bc5a None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:04.092027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258779a-0c37-404f-9147-b6e85675bc5a None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:04.127554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97c62-de40-4080-bbcb-cbeb07a8db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:04.128164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97c62-de40-4080-bbcb-cbeb07a8db61 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:04.128442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97c62-de40-4080-bbcb-cbeb07a8db61 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:04.128713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97c62-de40-4080-bbcb-cbeb07a8db61 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:04.129958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97c62-de40-4080-bbcb-cbeb07a8db61 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:04.132367 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97c62-de40-4080-bbcb-cbeb07a8db61 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:04.136716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:04.143729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.sql.core [None req-59f97c62-de40-4080-bbcb-cbeb07a8db61 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 04:37:04.143729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 04:37:04.143729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [parameters: {'id': '9b07eee6df6040878663a34ce306126e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 04:37:04.143729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93090) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-59f97c62-de40-4080-bbcb-cbeb07a8db61 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application conn.query(q) Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result.read() Oct 12 04:37:04.162548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return ref.to_dict() Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 04:37:04.163530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application next(self.gen) Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application yield resource Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application next(self.gen) Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise self.value Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application session.commit() Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 04:37:04.164484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.session.flush() Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application compat.raise_( Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 04:37:04.165320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 04:37:04.166199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application conn.query(q) Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result.read() Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 04:37:04.166994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [parameters: {'id': '9b07eee6df6040878663a34ce306126e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:04.167961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 04:37:04.168859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:04.169711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 181/359] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Oct 12 04:37:03 2022] POST /identity/v3/roles => generated 144 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:04.173176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534b49-4b57-49d1-8406-0e35b67ca49f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:04.251400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:04.306675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534b49-4b57-49d1-8406-0e35b67ca49f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:04.353159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ea4b7-9fcf-4321-8f23-03cd4d83dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:04.353712 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ea4b7-9fcf-4321-8f23-03cd4d83dee5 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:04.353999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ea4b7-9fcf-4321-8f23-03cd4d83dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:04.354273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ea4b7-9fcf-4321-8f23-03cd4d83dee5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:04.367521 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ea4b7-9fcf-4321-8f23-03cd4d83dee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-e13ea4b7-9fcf-4321-8f23-03cd4d83dee5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:04.372895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:04.373842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:04.374636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 179/360] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:37:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:04.380210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97c62-de40-4080-bbcb-cbeb07a8db61 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:04.505181 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97c62-de40-4080-bbcb-cbeb07a8db61 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:04.541154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf5840-f511-4d58-a3ab-5601971debcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:04.541820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf5840-f511-4d58-a3ab-5601971debcf None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:04.542099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf5840-f511-4d58-a3ab-5601971debcf None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:04.542372 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf5840-f511-4d58-a3ab-5601971debcf None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:04.543082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf5840-f511-4d58-a3ab-5601971debcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:04.543417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf5840-f511-4d58-a3ab-5601971debcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:04.544791 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf5840-f511-4d58-a3ab-5601971debcf None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:04.553982 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 182/361] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:05.757221 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620a3e0-ae87-4508-bb1e-8a3ca65a6adc None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:05.757901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620a3e0-ae87-4508-bb1e-8a3ca65a6adc None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:05.757901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620a3e0-ae87-4508-bb1e-8a3ca65a6adc None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:05.759273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 180/362] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:05.764533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14ac5-d081-44e4-89a4-ed2de94b3ef2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:05.765018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14ac5-d081-44e4-89a4-ed2de94b3ef2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:05.765183 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14ac5-d081-44e4-89a4-ed2de94b3ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:05.783473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8ba14ac5-d081-44e4-89a4-ed2de94b3ef2 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:05.784665 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8ba14ac5-d081-44e4-89a4-ed2de94b3ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:05.861451 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:05.878015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 183/363] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:37:06.245257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620a3e0-ae87-4508-bb1e-8a3ca65a6adc None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:06.363075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247e267-f55e-4b47-a895-d4f0ee4374e0 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:06.363510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247e267-f55e-4b47-a895-d4f0ee4374e0 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:06.363737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247e267-f55e-4b47-a895-d4f0ee4374e0 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:06.366303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 184/364] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:06.370171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9cf5-5913-4de4-9b87-b20c19df8a74 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:06.370459 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9cf5-5913-4de4-9b87-b20c19df8a74 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:06.370734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9cf5-5913-4de4-9b87-b20c19df8a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:06.373500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620a3e0-ae87-4508-bb1e-8a3ca65a6adc None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:06.407053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c37b9cf5-5913-4de4-9b87-b20c19df8a74 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:06.409792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c37b9cf5-5913-4de4-9b87-b20c19df8a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:06.413969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:06.438186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db65f7-783a-4a94-877d-a2e61aa53e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:06.438841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db65f7-783a-4a94-877d-a2e61aa53e48 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:06.439127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db65f7-783a-4a94-877d-a2e61aa53e48 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:06.439433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db65f7-783a-4a94-877d-a2e61aa53e48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:06.461758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db65f7-783a-4a94-877d-a2e61aa53e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-28db65f7-783a-4a94-877d-a2e61aa53e48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:06.468380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:06.469259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:06.470070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:06.476987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 181/365] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:06.479820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db65f7-783a-4a94-877d-a2e61aa53e48 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:06.547603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 185/366] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:37:06.557699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9a33-1542-46ef-84d9-164c62c6f882 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:06.557984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9a33-1542-46ef-84d9-164c62c6f882 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:06.558258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9a33-1542-46ef-84d9-164c62c6f882 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:06.559768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 186/367] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:06.565082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59505d-7e78-419d-ab9b-4229d7bc6e07 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:06.565365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59505d-7e78-419d-ab9b-4229d7bc6e07 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:06.565641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59505d-7e78-419d-ab9b-4229d7bc6e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:06.597050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-4e59505d-7e78-419d-ab9b-4229d7bc6e07 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:06.598291 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4e59505d-7e78-419d-ab9b-4229d7bc6e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:06.660281 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db65f7-783a-4a94-877d-a2e61aa53e48 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:06.687547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 187/368] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:06.688858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df590bd-19fa-4bf6-b7a0-252db418c58c None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:06.695417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df590bd-19fa-4bf6-b7a0-252db418c58c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:06.695813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df590bd-19fa-4bf6-b7a0-252db418c58c None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:06.697324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 188/369] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:06.702100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38667e-50e6-43b5-8c80-dcbae4032457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:06.702724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4887ab-3b9e-44ca-a22a-3f8fab4dccac None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:06.702929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38667e-50e6-43b5-8c80-dcbae4032457 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:06.703032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4887ab-3b9e-44ca-a22a-3f8fab4dccac None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:06.703269 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4887ab-3b9e-44ca-a22a-3f8fab4dccac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:06.703484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38667e-50e6-43b5-8c80-dcbae4032457 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:06.703907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38667e-50e6-43b5-8c80-dcbae4032457 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:06.704682 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38667e-50e6-43b5-8c80-dcbae4032457 None admin] RBAC: Adding query filter params (name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:06.705083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38667e-50e6-43b5-8c80-dcbae4032457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:06.706542 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38667e-50e6-43b5-8c80-dcbae4032457 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:06.717155 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 182/370] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:06.723035 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38667e-50e6-43b5-8c80-dcbae4032457 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:06.732836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8a4887ab-3b9e-44ca-a22a-3f8fab4dccac None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:06.734074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8a4887ab-3b9e-44ca-a22a-3f8fab4dccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:06.771738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:06.828111 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38667e-50e6-43b5-8c80-dcbae4032457 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:06.860700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:06.865645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84ff95-fd34-4750-bb5d-d2084d9a04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:06.866591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ff95-fd34-4750-bb5d-d2084d9a04f6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:06.867079 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ff95-fd34-4750-bb5d-d2084d9a04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:06.867577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ff95-fd34-4750-bb5d-d2084d9a04f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:06.878846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84ff95-fd34-4750-bb5d-d2084d9a04f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:06.881192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84ff95-fd34-4750-bb5d-d2084d9a04f6 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:06.884553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 189/371] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:06.885389 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4887ab-3b9e-44ca-a22a-3f8fab4dccac None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-2b84ff95-fd34-4750-bb5d-d2084d9a04f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:06.907307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:06.908265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:06.909116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:06.909116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:06.909116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:06.911006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 183/372] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:06.918362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84ff95-fd34-4750-bb5d-d2084d9a04f6 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.028036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84ff95-fd34-4750-bb5d-d2084d9a04f6 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.029808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:07.047224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4887ab-3b9e-44ca-a22a-3f8fab4dccac None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.067050 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281f815-51a4-4eda-b7a0-8dfda7f6a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.067840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281f815-51a4-4eda-b7a0-8dfda7f6a214 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.068221 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281f815-51a4-4eda-b7a0-8dfda7f6a214 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.068612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281f815-51a4-4eda-b7a0-8dfda7f6a214 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.069358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281f815-51a4-4eda-b7a0-8dfda7f6a214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:07.069762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281f815-51a4-4eda-b7a0-8dfda7f6a214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:07.071393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281f815-51a4-4eda-b7a0-8dfda7f6a214 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:07.083906 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 184/373] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:07.084603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281f815-51a4-4eda-b7a0-8dfda7f6a214 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.086231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e38a-97c0-4d38-b17f-fb8c7cf21b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.087036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e38a-97c0-4d38-b17f-fb8c7cf21b74 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.087506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e38a-97c0-4d38-b17f-fb8c7cf21b74 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.087903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e38a-97c0-4d38-b17f-fb8c7cf21b74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.100268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887e38a-97c0-4d38-b17f-fb8c7cf21b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-a887e38a-97c0-4d38-b17f-fb8c7cf21b74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:07.105667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:07.106764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:07.107593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:07.108549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 190/374] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:07.113390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e38a-97c0-4d38-b17f-fb8c7cf21b74 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.155944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:07.217712 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281f815-51a4-4eda-b7a0-8dfda7f6a214 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.220562 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e38a-97c0-4d38-b17f-fb8c7cf21b74 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.257377 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6c6d1-ab4c-4017-806f-e2a45dcdfcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.258019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c6d1-ab4c-4017-806f-e2a45dcdfcd5 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.258405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c6d1-ab4c-4017-806f-e2a45dcdfcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.258780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c6d1-ab4c-4017-806f-e2a45dcdfcd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.259714 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cbf5b-15f7-456c-a3dd-fede2c9bc0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.260349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cbf5b-15f7-456c-a3dd-fede2c9bc0bb None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.260693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cbf5b-15f7-456c-a3dd-fede2c9bc0bb None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.260974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cbf5b-15f7-456c-a3dd-fede2c9bc0bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.268706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cbf5b-15f7-456c-a3dd-fede2c9bc0bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:07.269348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6c6d1-ab4c-4017-806f-e2a45dcdfcd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:07.270308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cbf5b-15f7-456c-a3dd-fede2c9bc0bb None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-a9b6c6d1-ab4c-4017-806f-e2a45dcdfcd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:07.275791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:07.276676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:07.277493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:07.281714 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 185/375] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:07.282566 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6c6d1-ab4c-4017-806f-e2a45dcdfcd5 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-d35cbf5b-15f7-456c-a3dd-fede2c9bc0bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:07.283548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:07.284429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:07.287471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 191/376] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:07.290660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cbf5b-15f7-456c-a3dd-fede2c9bc0bb None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.301758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:07.383778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6c6d1-ab4c-4017-806f-e2a45dcdfcd5 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.388700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:07.391802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cbf5b-15f7-456c-a3dd-fede2c9bc0bb None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.417253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fe70d-abb2-4f0d-bd1a-0a87da581419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.417864 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fe70d-abb2-4f0d-bd1a-0a87da581419 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.418147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fe70d-abb2-4f0d-bd1a-0a87da581419 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.418425 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fe70d-abb2-4f0d-bd1a-0a87da581419 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.419089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fe70d-abb2-4f0d-bd1a-0a87da581419 None admin] RBAC: Adding query filter params (name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:07.419441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fe70d-abb2-4f0d-bd1a-0a87da581419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:07.420823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fe70d-abb2-4f0d-bd1a-0a87da581419 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:07.425031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084e9ec-87f1-4a59-a7ab-ffbd6fbee059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.425955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084e9ec-87f1-4a59-a7ab-ffbd6fbee059 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.425955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084e9ec-87f1-4a59-a7ab-ffbd6fbee059 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.426207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084e9ec-87f1-4a59-a7ab-ffbd6fbee059 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.426847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084e9ec-87f1-4a59-a7ab-ffbd6fbee059 None admin] RBAC: Adding query filter params (name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:07.427152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084e9ec-87f1-4a59-a7ab-ffbd6fbee059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:07.428542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084e9ec-87f1-4a59-a7ab-ffbd6fbee059 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:07.433323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 186/377] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:07.433323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fe70d-abb2-4f0d-bd1a-0a87da581419 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.436387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 192/378] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:07.437177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084e9ec-87f1-4a59-a7ab-ffbd6fbee059 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.511971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:07.533497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fe70d-abb2-4f0d-bd1a-0a87da581419 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.535790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084e9ec-87f1-4a59-a7ab-ffbd6fbee059 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.567059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95b62e-93a2-42e7-9d72-f55a5d14e6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.567702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95b62e-93a2-42e7-9d72-f55a5d14e6cd None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.567988 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95b62e-93a2-42e7-9d72-f55a5d14e6cd None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.568263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95b62e-93a2-42e7-9d72-f55a5d14e6cd None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.568991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95b62e-93a2-42e7-9d72-f55a5d14e6cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:07.569302 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95b62e-93a2-42e7-9d72-f55a5d14e6cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:07.569921 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5759c-437d-438a-90e1-7b999fd0fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.570549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5759c-437d-438a-90e1-7b999fd0fe11 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.570723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95b62e-93a2-42e7-9d72-f55a5d14e6cd None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:07.570815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5759c-437d-438a-90e1-7b999fd0fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.571088 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5759c-437d-438a-90e1-7b999fd0fe11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.583354 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5759c-437d-438a-90e1-7b999fd0fe11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-60a5759c-437d-438a-90e1-7b999fd0fe11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:07.588552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:07.589530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:07.590589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 193/379] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:07.591727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2be3-d6f0-4a5b-9dd4-76a54dc287c4 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.591727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2be3-d6f0-4a5b-9dd4-76a54dc287c4 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.591727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2be3-d6f0-4a5b-9dd4-76a54dc287c4 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.595318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 194/380] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:07.595318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd2be3-d6f0-4a5b-9dd4-76a54dc287c4 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.609334 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 187/381] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:07.610191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95b62e-93a2-42e7-9d72-f55a5d14e6cd None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.623083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:07.699563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd2be3-d6f0-4a5b-9dd4-76a54dc287c4 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.709790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95b62e-93a2-42e7-9d72-f55a5d14e6cd None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.732166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f641-47c7-45b1-9650-34fac4f03cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.732793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f641-47c7-45b1-9650-34fac4f03cde None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.733069 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f641-47c7-45b1-9650-34fac4f03cde None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.733340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f641-47c7-45b1-9650-34fac4f03cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.742607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f92949-b15d-4799-80c4-d6f7f1389a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.742849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f641-47c7-45b1-9650-34fac4f03cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:07.743227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f92949-b15d-4799-80c4-d6f7f1389a82 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.743540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f92949-b15d-4799-80c4-d6f7f1389a82 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.743815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f92949-b15d-4799-80c4-d6f7f1389a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.744308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f641-47c7-45b1-9650-34fac4f03cde None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:07.746419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:07.754598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f92949-b15d-4799-80c4-d6f7f1389a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:07.756070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f92949-b15d-4799-80c4-d6f7f1389a82 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-a5d3f641-47c7-45b1-9650-34fac4f03cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:07.758916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:07.759957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:07.760831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:07.760831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:07.760831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:07.760831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 195/382] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:07.761235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f641-47c7-45b1-9650-34fac4f03cde None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-72f92949-b15d-4799-80c4-d6f7f1389a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:07.771206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:07.772616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:07.773475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:07.773475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:07.773475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:07.773475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 188/383] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:07.773696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56fef-27cd-4ed3-a2a8-3082583f4c8a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.773798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56fef-27cd-4ed3-a2a8-3082583f4c8a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.774081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56fef-27cd-4ed3-a2a8-3082583f4c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.791241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-9cc56fef-27cd-4ed3-a2a8-3082583f4c8a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:07.792450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9cc56fef-27cd-4ed3-a2a8-3082583f4c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:07.840771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:07.857240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 189/384] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:07.858058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc56fef-27cd-4ed3-a2a8-3082583f4c8a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.865242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f641-47c7-45b1-9650-34fac4f03cde None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:07.900824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42278f44-87ab-45b0-a90a-ad668ef4d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:07.901586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42278f44-87ab-45b0-a90a-ad668ef4d188 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:07.901861 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42278f44-87ab-45b0-a90a-ad668ef4d188 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:07.902441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42278f44-87ab-45b0-a90a-ad668ef4d188 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:07.903094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42278f44-87ab-45b0-a90a-ad668ef4d188 None admin] RBAC: Adding query filter params (name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:07.903426 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42278f44-87ab-45b0-a90a-ad668ef4d188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:07.904856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42278f44-87ab-45b0-a90a-ad668ef4d188 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:07.917648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 196/385] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:07.917648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42278f44-87ab-45b0-a90a-ad668ef4d188 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:07.983558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc56fef-27cd-4ed3-a2a8-3082583f4c8a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.002143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:08.017938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42278f44-87ab-45b0-a90a-ad668ef4d188 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.021425 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027b399-1ac3-4f82-b968-c4c789658101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.022058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b399-1ac3-4f82-b968-c4c789658101 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.022345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b399-1ac3-4f82-b968-c4c789658101 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.022621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b399-1ac3-4f82-b968-c4c789658101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.034312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027b399-1ac3-4f82-b968-c4c789658101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.035839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027b399-1ac3-4f82-b968-c4c789658101 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-3027b399-1ac3-4f82-b968-c4c789658101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:08.051577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:08.052491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:08.053344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:08.053344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:08.053344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:08.053344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 190/386] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:08.053344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027b399-1ac3-4f82-b968-c4c789658101 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.060847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6b9ed-a968-4c6f-8e69-6df30df40c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.061464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6b9ed-a968-4c6f-8e69-6df30df40c8c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.061751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6b9ed-a968-4c6f-8e69-6df30df40c8c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.062034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6b9ed-a968-4c6f-8e69-6df30df40c8c None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.062674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6b9ed-a968-4c6f-8e69-6df30df40c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:08.062983 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6b9ed-a968-4c6f-8e69-6df30df40c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.064393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6b9ed-a968-4c6f-8e69-6df30df40c8c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.068143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:08.083237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 197/387] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:08.083237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6b9ed-a968-4c6f-8e69-6df30df40c8c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.161987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027b399-1ac3-4f82-b968-c4c789658101 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.179802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6b9ed-a968-4c6f-8e69-6df30df40c8c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.195571 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9cb01-10f4-4357-af69-a9b6a04fee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.196172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9cb01-10f4-4357-af69-a9b6a04fee45 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.196455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9cb01-10f4-4357-af69-a9b6a04fee45 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.196727 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9cb01-10f4-4357-af69-a9b6a04fee45 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.197372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9cb01-10f4-4357-af69-a9b6a04fee45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:08.197675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9cb01-10f4-4357-af69-a9b6a04fee45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.199037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9cb01-10f4-4357-af69-a9b6a04fee45 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.210575 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 191/388] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:08.211482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9cb01-10f4-4357-af69-a9b6a04fee45 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.214495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad328f9-6d90-41ca-a235-0963059edde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.215426 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad328f9-6d90-41ca-a235-0963059edde9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.215704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad328f9-6d90-41ca-a235-0963059edde9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.215976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad328f9-6d90-41ca-a235-0963059edde9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.226116 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad328f9-6d90-41ca-a235-0963059edde9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.227603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad328f9-6d90-41ca-a235-0963059edde9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-9ad328f9-6d90-41ca-a235-0963059edde9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:08.242127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:08.243017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:08.243936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:08.243936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:08.243936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:08.243936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 198/389] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:08.243936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad328f9-6d90-41ca-a235-0963059edde9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.244648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:08.295685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:08.313811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9cb01-10f4-4357-af69-a9b6a04fee45 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.346166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad328f9-6d90-41ca-a235-0963059edde9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.347501 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7f88e-8093-483f-b014-cfdf5b56f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.348166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7f88e-8093-483f-b014-cfdf5b56f971 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.348452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7f88e-8093-483f-b014-cfdf5b56f971 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.348730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7f88e-8093-483f-b014-cfdf5b56f971 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.349369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7f88e-8093-483f-b014-cfdf5b56f971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:08.349678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7f88e-8093-483f-b014-cfdf5b56f971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.351054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7f88e-8093-483f-b014-cfdf5b56f971 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.361971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 192/390] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:08.363043 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7f88e-8093-483f-b014-cfdf5b56f971 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.379663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608adb8-b6cd-42ab-ac58-a1862d5e3345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.380298 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608adb8-b6cd-42ab-ac58-a1862d5e3345 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.380580 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608adb8-b6cd-42ab-ac58-a1862d5e3345 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.380854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608adb8-b6cd-42ab-ac58-a1862d5e3345 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.388145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608adb8-b6cd-42ab-ac58-a1862d5e3345 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.389586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608adb8-b6cd-42ab-ac58-a1862d5e3345 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-8608adb8-b6cd-42ab-ac58-a1862d5e3345 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:08.400501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:08.401455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 199/391] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:08.402788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608adb8-b6cd-42ab-ac58-a1862d5e3345 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.457064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:08.467525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7f88e-8093-483f-b014-cfdf5b56f971 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.501176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608adb8-b6cd-42ab-ac58-a1862d5e3345 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.501454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb1269-8bce-4dd6-a965-eba0539a5093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.502080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb1269-8bce-4dd6-a965-eba0539a5093 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.502368 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb1269-8bce-4dd6-a965-eba0539a5093 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.502648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb1269-8bce-4dd6-a965-eba0539a5093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.509915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:08.514375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb1269-8bce-4dd6-a965-eba0539a5093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.515880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb1269-8bce-4dd6-a965-eba0539a5093 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-a4eb1269-8bce-4dd6-a965-eba0539a5093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:08.529683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:08.530590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:08.531489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:08.531489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:08.531489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:08.531489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 193/392] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:08.531719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb1269-8bce-4dd6-a965-eba0539a5093 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.536067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d4b0-266b-408f-9a06-04762732f163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.536222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d4b0-266b-408f-9a06-04762732f163 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.536654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d4b0-266b-408f-9a06-04762732f163 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.536937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d4b0-266b-408f-9a06-04762732f163 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.544443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40d4b0-266b-408f-9a06-04762732f163 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.545886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40d4b0-266b-408f-9a06-04762732f163 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-fb40d4b0-266b-408f-9a06-04762732f163 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:08.556871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:08.557774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 200/393] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:08.558751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d4b0-266b-408f-9a06-04762732f163 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.636461 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb1269-8bce-4dd6-a965-eba0539a5093 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.658781 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d4b0-266b-408f-9a06-04762732f163 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.668836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d0f2e-2096-477d-9142-b5d04ce39dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.669520 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d0f2e-2096-477d-9142-b5d04ce39dda None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.669800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d0f2e-2096-477d-9142-b5d04ce39dda None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.670071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d0f2e-2096-477d-9142-b5d04ce39dda None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.670698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d0f2e-2096-477d-9142-b5d04ce39dda None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:08.670999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d0f2e-2096-477d-9142-b5d04ce39dda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.672399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d0f2e-2096-477d-9142-b5d04ce39dda None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.683657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 194/394] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:08.684427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d0f2e-2096-477d-9142-b5d04ce39dda None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.686805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:08.695010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba58a15-11ab-4fab-bfb0-be1c0f278efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.695685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58a15-11ab-4fab-bfb0-be1c0f278efc None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.695970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58a15-11ab-4fab-bfb0-be1c0f278efc None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.696249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58a15-11ab-4fab-bfb0-be1c0f278efc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.702851 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba58a15-11ab-4fab-bfb0-be1c0f278efc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.704353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba58a15-11ab-4fab-bfb0-be1c0f278efc None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-aba58a15-11ab-4fab-bfb0-be1c0f278efc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:08.716263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:08.717216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:08.718064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:08.718064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:08.718064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:08.718064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:08.718064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:08.718064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:08.718064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:08.718064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:08.718064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 201/395] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:08.718910 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba58a15-11ab-4fab-bfb0-be1c0f278efc None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.748372 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:08.782762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d0f2e-2096-477d-9142-b5d04ce39dda None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.816907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ec725-0406-4424-8700-b4d4d7baecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.817511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ec725-0406-4424-8700-b4d4d7baecf4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.817793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ec725-0406-4424-8700-b4d4d7baecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.818066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ec725-0406-4424-8700-b4d4d7baecf4 None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.818165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba58a15-11ab-4fab-bfb0-be1c0f278efc None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.818785 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ec725-0406-4424-8700-b4d4d7baecf4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:08.819093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ec725-0406-4424-8700-b4d4d7baecf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.820543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ec725-0406-4424-8700-b4d4d7baecf4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.837503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 195/396] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:08.838449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ec725-0406-4424-8700-b4d4d7baecf4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.851660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6b28e-dc7b-484d-8714-9a65f8bcc8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.852276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6b28e-dc7b-484d-8714-9a65f8bcc8f5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.852562 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6b28e-dc7b-484d-8714-9a65f8bcc8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.852844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6b28e-dc7b-484d-8714-9a65f8bcc8f5 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.853482 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6b28e-dc7b-484d-8714-9a65f8bcc8f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:08.853791 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6b28e-dc7b-484d-8714-9a65f8bcc8f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.855157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6b28e-dc7b-484d-8714-9a65f8bcc8f5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.866571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 202/397] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:08.867385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6b28e-dc7b-484d-8714-9a65f8bcc8f5 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:08.903686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:08.945545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ec725-0406-4424-8700-b4d4d7baecf4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.953088 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:08.965022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6b28e-dc7b-484d-8714-9a65f8bcc8f5 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:08.981110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed394f-2fca-4b93-8984-9cb13fee5d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.981922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed394f-2fca-4b93-8984-9cb13fee5d71 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:08.982203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed394f-2fca-4b93-8984-9cb13fee5d71 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:08.982474 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed394f-2fca-4b93-8984-9cb13fee5d71 None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:08.983255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed394f-2fca-4b93-8984-9cb13fee5d71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:08.983585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed394f-2fca-4b93-8984-9cb13fee5d71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:08.984997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed394f-2fca-4b93-8984-9cb13fee5d71 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:08.999061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511c8f-9329-4092-8f81-caa7e141c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:08.999718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511c8f-9329-4092-8f81-caa7e141c895 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.000081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511c8f-9329-4092-8f81-caa7e141c895 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.000272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511c8f-9329-4092-8f81-caa7e141c895 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.002187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 196/398] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:09.002996 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed394f-2fca-4b93-8984-9cb13fee5d71 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.012212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511c8f-9329-4092-8f81-caa7e141c895 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.013644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511c8f-9329-4092-8f81-caa7e141c895 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-72511c8f-9329-4092-8f81-caa7e141c895 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:09.025013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:09.025882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:09.026783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 203/399] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:09.027398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511c8f-9329-4092-8f81-caa7e141c895 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.104163 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed394f-2fca-4b93-8984-9cb13fee5d71 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:09.121248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:09.123119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511c8f-9329-4092-8f81-caa7e141c895 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:09.137797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a662d91-378b-4ac1-8bf3-6c38c77750a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:09.138393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662d91-378b-4ac1-8bf3-6c38c77750a7 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.138675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662d91-378b-4ac1-8bf3-6c38c77750a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.138951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662d91-378b-4ac1-8bf3-6c38c77750a7 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.139731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a662d91-378b-4ac1-8bf3-6c38c77750a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:09.140021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a662d91-378b-4ac1-8bf3-6c38c77750a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.141433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a662d91-378b-4ac1-8bf3-6c38c77750a7 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.155187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa389-ff44-4171-a1ce-adee10bb400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:09.155833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa389-ff44-4171-a1ce-adee10bb400b None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.156109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa389-ff44-4171-a1ce-adee10bb400b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.156375 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa389-ff44-4171-a1ce-adee10bb400b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.158850 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 197/400] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:09.159646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a662d91-378b-4ac1-8bf3-6c38c77750a7 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.167205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fa389-ff44-4171-a1ce-adee10bb400b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.168680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fa389-ff44-4171-a1ce-adee10bb400b None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.176411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-e83fa389-ff44-4171-a1ce-adee10bb400b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:09.182950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:09.184106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:09.184972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:09.184972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:09.184972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:09.186046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 204/401] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:09.186833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa389-ff44-4171-a1ce-adee10bb400b None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.264640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a662d91-378b-4ac1-8bf3-6c38c77750a7 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:09.284842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa389-ff44-4171-a1ce-adee10bb400b None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:09.300550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8591e-26e2-4005-a423-4624efefbc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:09.301689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8591e-26e2-4005-a423-4624efefbc9d None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.301975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8591e-26e2-4005-a423-4624efefbc9d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.302246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8591e-26e2-4005-a423-4624efefbc9d None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.302883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8591e-26e2-4005-a423-4624efefbc9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.304347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8591e-26e2-4005-a423-4624efefbc9d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.317825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe15f9-ba21-49ab-bd62-48861387c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:09.318433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe15f9-ba21-49ab-bd62-48861387c9fb None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.318711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe15f9-ba21-49ab-bd62-48861387c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.318982 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe15f9-ba21-49ab-bd62-48861387c9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.324577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 198/402] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:37:09 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:09.325398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8591e-26e2-4005-a423-4624efefbc9d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.329666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe15f9-ba21-49ab-bd62-48861387c9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.331164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe15f9-ba21-49ab-bd62-48861387c9fb None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-bebe15f9-ba21-49ab-bd62-48861387c9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:09.350561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:09.351639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:09.352486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:09.352486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:09.352486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:09.352486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 205/403] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:09.352702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe15f9-ba21-49ab-bd62-48861387c9fb None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.377970 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:09.413396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:09.458215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8591e-26e2-4005-a423-4624efefbc9d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:09.468531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe15f9-ba21-49ab-bd62-48861387c9fb None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:09.498484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc4d66-c503-4b6a-98e5-385e9626f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:09.499211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4d66-c503-4b6a-98e5-385e9626f850 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.500098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4d66-c503-4b6a-98e5-385e9626f850 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.500098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4d66-c503-4b6a-98e5-385e9626f850 None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.500404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc4d66-c503-4b6a-98e5-385e9626f850 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:09.500707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc4d66-c503-4b6a-98e5-385e9626f850 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.502300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc4d66-c503-4b6a-98e5-385e9626f850 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.506378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e66835-a3a6-4aac-a554-4660edb65774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:09.507111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e66835-a3a6-4aac-a554-4660edb65774 None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.508653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e66835-a3a6-4aac-a554-4660edb65774 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.508653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e66835-a3a6-4aac-a554-4660edb65774 None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/7e02bef3699b4569986b36cec686931a/roles/bb0934f87e1f44729e10e428242ea249` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.524369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 199/404] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Oct 12 04:37:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:09.525007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc4d66-c503-4b6a-98e5-385e9626f850 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.526761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e66835-a3a6-4aac-a554-4660edb65774 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=7e02bef3699b4569986b36cec686931a, role_id=bb0934f87e1f44729e10e428242ea249)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.528313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e66835-a3a6-4aac-a554-4660edb65774 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.555457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 206/405] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:37:09 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/7e02bef3699b4569986b36cec686931a/roles/bb0934f87e1f44729e10e428242ea249 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:37:09.556552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e66835-a3a6-4aac-a554-4660edb65774 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.647993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:09.658934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc4d66-c503-4b6a-98e5-385e9626f850 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:09.705178 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabfed-6deb-4a4e-8047-ca656a8ea8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:09.705989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabfed-6deb-4a4e-8047-ca656a8ea8ec None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.706368 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabfed-6deb-4a4e-8047-ca656a8ea8ec None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.706740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabfed-6deb-4a4e-8047-ca656a8ea8ec None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.708251 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dabfed-6deb-4a4e-8047-ca656a8ea8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:09.708657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dabfed-6deb-4a4e-8047-ca656a8ea8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.710846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dabfed-6deb-4a4e-8047-ca656a8ea8ec None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.716740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e66835-a3a6-4aac-a554-4660edb65774 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:09.718670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:09.727000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 200/406] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:09.728122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabfed-6deb-4a4e-8047-ca656a8ea8ec None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.757249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cd059-6398-4148-afe1-35dbec0ca42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:09.757963 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cd059-6398-4148-afe1-35dbec0ca42b None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.758151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cd059-6398-4148-afe1-35dbec0ca42b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.758485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cd059-6398-4148-afe1-35dbec0ca42b None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.759134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cd059-6398-4148-afe1-35dbec0ca42b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:09.759526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cd059-6398-4148-afe1-35dbec0ca42b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.761557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cd059-6398-4148-afe1-35dbec0ca42b None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.776928 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 207/407] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:09.777617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cd059-6398-4148-afe1-35dbec0ca42b None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.844855 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabfed-6deb-4a4e-8047-ca656a8ea8ec None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:09.883599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4ee4-d88e-4703-9456-c0df02b78d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:09.884326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4ee4-d88e-4703-9456-c0df02b78d08 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.884613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4ee4-d88e-4703-9456-c0df02b78d08 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.884887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4ee4-d88e-4703-9456-c0df02b78d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.894391 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cd059-6398-4148-afe1-35dbec0ca42b None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:09.896888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4ee4-d88e-4703-9456-c0df02b78d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.898537 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4ee4-d88e-4703-9456-c0df02b78d08 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-055e4ee4-d88e-4703-9456-c0df02b78d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:09.914292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:09.915200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:09.916078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:09.916078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:09.916078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:09.916078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 201/408] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:09.916706 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4ee4-d88e-4703-9456-c0df02b78d08 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:09.927315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:09.942184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c306e-391b-4c37-8ad0-b17aee72b8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:09.942823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c306e-391b-4c37-8ad0-b17aee72b8fb None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:09.943167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c306e-391b-4c37-8ad0-b17aee72b8fb None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:09.943579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c306e-391b-4c37-8ad0-b17aee72b8fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:09.951250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c306e-391b-4c37-8ad0-b17aee72b8fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:09.953426 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c306e-391b-4c37-8ad0-b17aee72b8fb None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-cc4c306e-391b-4c37-8ad0-b17aee72b8fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:09.974461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:09.975639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:09.976716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:09.976716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:09.976716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:09.976716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:09.976716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:09.976716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:09.976716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:09.976716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:09.979197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 208/409] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:09.980601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c306e-391b-4c37-8ad0-b17aee72b8fb None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:10.013432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:10.043314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4ee4-d88e-4703-9456-c0df02b78d08 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:10.082233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065334c-56cf-4144-bbdf-60cd2e0716e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:10.083047 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065334c-56cf-4144-bbdf-60cd2e0716e5 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:10.083459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065334c-56cf-4144-bbdf-60cd2e0716e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:10.083821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065334c-56cf-4144-bbdf-60cd2e0716e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:10.091821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065334c-56cf-4144-bbdf-60cd2e0716e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:10.093908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065334c-56cf-4144-bbdf-60cd2e0716e5 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:10.096622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c306e-391b-4c37-8ad0-b17aee72b8fb None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-2065334c-56cf-4144-bbdf-60cd2e0716e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:10.107149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:10.108126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:10.108966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:10.108966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:10.108966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:10.108966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:10.108966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:10.108966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:10.108966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:10.108966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:10.108966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 202/410] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:10.109924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065334c-56cf-4144-bbdf-60cd2e0716e5 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:10.134637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64c576-d2f1-4306-a209-512e475618ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:10.135251 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64c576-d2f1-4306-a209-512e475618ce None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:10.135574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64c576-d2f1-4306-a209-512e475618ce None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:10.135851 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64c576-d2f1-4306-a209-512e475618ce None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:10.136489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64c576-d2f1-4306-a209-512e475618ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:10.136793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64c576-d2f1-4306-a209-512e475618ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:10.138270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64c576-d2f1-4306-a209-512e475618ce None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:10.151972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 209/411] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:10.152809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64c576-d2f1-4306-a209-512e475618ce None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:10.182231 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:10.230376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065334c-56cf-4144-bbdf-60cd2e0716e5 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:10.244607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:10.267456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64c576-d2f1-4306-a209-512e475618ce None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:10.268628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187878b-83e0-4db4-868b-f57ff7c0ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:10.269421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187878b-83e0-4db4-868b-f57ff7c0ac8c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:10.270390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187878b-83e0-4db4-868b-f57ff7c0ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:10.270798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187878b-83e0-4db4-868b-f57ff7c0ac8c None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:10.271643 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187878b-83e0-4db4-868b-f57ff7c0ac8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:10.272085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187878b-83e0-4db4-868b-f57ff7c0ac8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:10.273656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187878b-83e0-4db4-868b-f57ff7c0ac8c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:10.287026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 203/412] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:10.288078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187878b-83e0-4db4-868b-f57ff7c0ac8c None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:10.315497 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24688fb3-aa09-42a6-bcd1-80568fc0c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:10.316986 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24688fb3-aa09-42a6-bcd1-80568fc0c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:10.317408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24688fb3-aa09-42a6-bcd1-80568fc0c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:10.317995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24688fb3-aa09-42a6-bcd1-80568fc0c3a3 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:10.319148 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24688fb3-aa09-42a6-bcd1-80568fc0c3a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:10.319888 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24688fb3-aa09-42a6-bcd1-80568fc0c3a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:10.321622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24688fb3-aa09-42a6-bcd1-80568fc0c3a3 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:10.344164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 210/413] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:10.345557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24688fb3-aa09-42a6-bcd1-80568fc0c3a3 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:10.405868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187878b-83e0-4db4-868b-f57ff7c0ac8c None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:10.434280 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:10.448435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe986-ecd8-4adf-b6a8-c9a8b0e51ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:10.449661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe986-ecd8-4adf-b6a8-c9a8b0e51ccd None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:10.450171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe986-ecd8-4adf-b6a8-c9a8b0e51ccd None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:10.450619 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe986-ecd8-4adf-b6a8-c9a8b0e51ccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:10.459189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfe986-ecd8-4adf-b6a8-c9a8b0e51ccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:10.461400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfe986-ecd8-4adf-b6a8-c9a8b0e51ccd None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:10.466041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24688fb3-aa09-42a6-bcd1-80568fc0c3a3 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-dacfe986-ecd8-4adf-b6a8-c9a8b0e51ccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:10.476144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:10.477018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:10.477863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:10.477863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:10.477863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:10.477863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:10.477863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:10.477863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:10.477863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:10.477863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:10.480837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 204/414] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:10.481924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe986-ecd8-4adf-b6a8-c9a8b0e51ccd None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:10.507108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb059f-c0e8-46b7-a88d-0a9c91f63d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:10.507821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb059f-c0e8-46b7-a88d-0a9c91f63d08 None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:10.508104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb059f-c0e8-46b7-a88d-0a9c91f63d08 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:10.508380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb059f-c0e8-46b7-a88d-0a9c91f63d08 None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/946db23ba1fe47999ae12f8380f4c48a/roles/bb0934f87e1f44729e10e428242ea249` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:10.525327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:10.529719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb059f-c0e8-46b7-a88d-0a9c91f63d08 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=946db23ba1fe47999ae12f8380f4c48a, role_id=bb0934f87e1f44729e10e428242ea249)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:10.532166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb059f-c0e8-46b7-a88d-0a9c91f63d08 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:10.553525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 211/415] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:37:10 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/946db23ba1fe47999ae12f8380f4c48a/roles/bb0934f87e1f44729e10e428242ea249 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:37:10.553525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb059f-c0e8-46b7-a88d-0a9c91f63d08 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:10.661774 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe986-ecd8-4adf-b6a8-c9a8b0e51ccd None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:10.676624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb059f-c0e8-46b7-a88d-0a9c91f63d08 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:10.718144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7df8f8-1df9-4745-8585-17c4f1dcab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:10.718772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7df8f8-1df9-4745-8585-17c4f1dcab0c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:10.719051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7df8f8-1df9-4745-8585-17c4f1dcab0c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:10.719344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7df8f8-1df9-4745-8585-17c4f1dcab0c None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:10.720527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7df8f8-1df9-4745-8585-17c4f1dcab0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:10.720836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7df8f8-1df9-4745-8585-17c4f1dcab0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:10.723221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7df8f8-1df9-4745-8585-17c4f1dcab0c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:10.736090 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6320-9388-4f6c-abda-5fd8e31272ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:10.737144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6320-9388-4f6c-abda-5fd8e31272ea None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:10.737633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6320-9388-4f6c-abda-5fd8e31272ea None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:10.737947 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 212/416] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:10.738493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6320-9388-4f6c-abda-5fd8e31272ea None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/c894579b2b2943409412afbbfe779aa4/roles/bb0934f87e1f44729e10e428242ea249` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:10.744779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7df8f8-1df9-4745-8585-17c4f1dcab0c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:10.758962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff6320-9388-4f6c-abda-5fd8e31272ea None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=c894579b2b2943409412afbbfe779aa4, role_id=bb0934f87e1f44729e10e428242ea249)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:10.760754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff6320-9388-4f6c-abda-5fd8e31272ea None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:10.777990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 205/417] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:37:10 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/c894579b2b2943409412afbbfe779aa4/roles/bb0934f87e1f44729e10e428242ea249 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:37:10.803323 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:10.859787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7df8f8-1df9-4745-8585-17c4f1dcab0c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:10.902701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e4cd7-c7ea-4882-8023-ff7725003800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:10.903500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4cd7-c7ea-4882-8023-ff7725003800 None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:10.903738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4cd7-c7ea-4882-8023-ff7725003800 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:10.904013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4cd7-c7ea-4882-8023-ff7725003800 None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/dc59d3cc1fbc4d4382bffd8ae93075e1/roles/bb0934f87e1f44729e10e428242ea249` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:10.926463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e4cd7-c7ea-4882-8023-ff7725003800 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=dc59d3cc1fbc4d4382bffd8ae93075e1, role_id=bb0934f87e1f44729e10e428242ea249)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:10.927879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e4cd7-c7ea-4882-8023-ff7725003800 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:10.950192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 213/418] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:37:10 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/dc59d3cc1fbc4d4382bffd8ae93075e1/roles/bb0934f87e1f44729e10e428242ea249 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:37:11.860321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c1fb4-80d8-43d1-b376-2641eb213d96 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:11.860819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c1fb4-80d8-43d1-b376-2641eb213d96 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:11.860819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c1fb4-80d8-43d1-b376-2641eb213d96 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:11.862118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 206/419] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:11.867889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811dd0e-44da-47e7-bfed-0dc8446c5eb5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:11.868181 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811dd0e-44da-47e7-bfed-0dc8446c5eb5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:11.868459 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811dd0e-44da-47e7-bfed-0dc8446c5eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:11.892283 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-5811dd0e-44da-47e7-bfed-0dc8446c5eb5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:11.893496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5811dd0e-44da-47e7-bfed-0dc8446c5eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:11.921315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f3736-ea3a-4a87-ba5f-50635c8847c1 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:11.922061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f3736-ea3a-4a87-ba5f-50635c8847c1 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:11.922901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f3736-ea3a-4a87-ba5f-50635c8847c1 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:11.924944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 207/420] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:11.931669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80f0f1-c75f-47e0-ac82-1c7582a866fa None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:11.932192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80f0f1-c75f-47e0-ac82-1c7582a866fa None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:11.932662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80f0f1-c75f-47e0-ac82-1c7582a866fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:11.951327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6f80f0f1-c75f-47e0-ac82-1c7582a866fa None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:11.952832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6f80f0f1-c75f-47e0-ac82-1c7582a866fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:11.985617 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:12.002122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 214/421] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:12.035382 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 208/422] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:37:12.365704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811dd0e-44da-47e7-bfed-0dc8446c5eb5 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:12.396352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:12.453665 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80f0f1-c75f-47e0-ac82-1c7582a866fa None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:12.468750 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811dd0e-44da-47e7-bfed-0dc8446c5eb5 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:12.506063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b446a-9497-46d0-bdcd-4b30020cc5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:12.507042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b446a-9497-46d0-bdcd-4b30020cc5a9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:12.507356 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b446a-9497-46d0-bdcd-4b30020cc5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:12.507847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b446a-9497-46d0-bdcd-4b30020cc5a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:12.519058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b446a-9497-46d0-bdcd-4b30020cc5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-d69b446a-9497-46d0-bdcd-4b30020cc5a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:12.524792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:12.525686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:12.526748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 215/423] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:12.532331 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b446a-9497-46d0-bdcd-4b30020cc5a9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:12.635774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:12.648031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b446a-9497-46d0-bdcd-4b30020cc5a9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:12.687695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569224c-fbd8-415b-97c8-576476c20294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:12.688320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569224c-fbd8-415b-97c8-576476c20294 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:12.688601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569224c-fbd8-415b-97c8-576476c20294 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:12.688872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569224c-fbd8-415b-97c8-576476c20294 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:12.689543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569224c-fbd8-415b-97c8-576476c20294 None admin] RBAC: Adding query filter params (name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:12.689848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569224c-fbd8-415b-97c8-576476c20294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:12.691267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569224c-fbd8-415b-97c8-576476c20294 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:12.714696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 216/424] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:12.719950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569224c-fbd8-415b-97c8-576476c20294 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:12.721861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80f0f1-c75f-47e0-ac82-1c7582a866fa None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:12.759264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00171d10-676e-4ab6-ad98-30bd28aba9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:12.759925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00171d10-676e-4ab6-ad98-30bd28aba9b4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:12.760209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00171d10-676e-4ab6-ad98-30bd28aba9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:12.760487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00171d10-676e-4ab6-ad98-30bd28aba9b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:12.771887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00171d10-676e-4ab6-ad98-30bd28aba9b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-00171d10-676e-4ab6-ad98-30bd28aba9b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:12.776760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:12.777656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:12.778889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 209/425] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:12.785803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00171d10-676e-4ab6-ad98-30bd28aba9b4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:12.821578 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:12.890120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569224c-fbd8-415b-97c8-576476c20294 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:12.942886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b1bfc-5cf8-4dd1-861a-57e0e539df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:12.944034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b1bfc-5cf8-4dd1-861a-57e0e539df8b None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:12.944513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b1bfc-5cf8-4dd1-861a-57e0e539df8b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:12.944980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b1bfc-5cf8-4dd1-861a-57e0e539df8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:12.956400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00171d10-676e-4ab6-ad98-30bd28aba9b4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:12.957489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b1bfc-5cf8-4dd1-861a-57e0e539df8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:12.959336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b1bfc-5cf8-4dd1-861a-57e0e539df8b None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-300b1bfc-5cf8-4dd1-861a-57e0e539df8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:12.975641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:12.976579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:12.977415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:12.977415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:12.977415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:12.983405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 217/426] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:12.985617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b1bfc-5cf8-4dd1-861a-57e0e539df8b None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:13.005732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:13.011646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba188c-6ff7-4af1-ad99-5f92c5ca504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:13.012515 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba188c-6ff7-4af1-ad99-5f92c5ca504c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.013015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba188c-6ff7-4af1-ad99-5f92c5ca504c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.013495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba188c-6ff7-4af1-ad99-5f92c5ca504c None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.014936 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba188c-6ff7-4af1-ad99-5f92c5ca504c None admin] RBAC: Adding query filter params (name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:13.015871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba188c-6ff7-4af1-ad99-5f92c5ca504c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:13.018926 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba188c-6ff7-4af1-ad99-5f92c5ca504c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:13.043397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 210/427] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:13.048545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba188c-6ff7-4af1-ad99-5f92c5ca504c None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:13.149065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:13.169484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba188c-6ff7-4af1-ad99-5f92c5ca504c None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:13.228361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dceee9-cb11-460e-af1c-e9b8282af59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:13.230086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dceee9-cb11-460e-af1c-e9b8282af59f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.231137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dceee9-cb11-460e-af1c-e9b8282af59f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.231830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dceee9-cb11-460e-af1c-e9b8282af59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.233818 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b1bfc-5cf8-4dd1-861a-57e0e539df8b None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:13.260194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dceee9-cb11-460e-af1c-e9b8282af59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:13.262059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dceee9-cb11-460e-af1c-e9b8282af59f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-56dceee9-cb11-460e-af1c-e9b8282af59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:13.282062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:13.282986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:13.283873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:13.283873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:13.283873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:13.286510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 211/428] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:13.288097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486717-f2c3-43fd-889c-f5bb8445a693 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.288612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486717-f2c3-43fd-889c-f5bb8445a693 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.289080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486717-f2c3-43fd-889c-f5bb8445a693 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.290495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 212/429] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:13.292114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28486717-f2c3-43fd-889c-f5bb8445a693 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:13.295012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2682a-b80b-4ca5-9290-c1fee3d6c13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:13.297666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2682a-b80b-4ca5-9290-c1fee3d6c13c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.298152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2682a-b80b-4ca5-9290-c1fee3d6c13c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.298632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2682a-b80b-4ca5-9290-c1fee3d6c13c None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.299740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2682a-b80b-4ca5-9290-c1fee3d6c13c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:13.300396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2682a-b80b-4ca5-9290-c1fee3d6c13c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:13.302944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2682a-b80b-4ca5-9290-c1fee3d6c13c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:13.320937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 218/430] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:13.322589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d763c0-17b3-434a-99be-e666f5c23720 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.323078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d763c0-17b3-434a-99be-e666f5c23720 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.323706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d763c0-17b3-434a-99be-e666f5c23720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.352872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b7d763c0-17b3-434a-99be-e666f5c23720 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:13.354388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b7d763c0-17b3-434a-99be-e666f5c23720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:13.409304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28486717-f2c3-43fd-889c-f5bb8445a693 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:13.440256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 219/431] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:13.440786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:13.447987 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d763c0-17b3-434a-99be-e666f5c23720 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:13.460713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb5b39-0e23-41ab-8796-b9449cdb72c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:13.461336 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb5b39-0e23-41ab-8796-b9449cdb72c8 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.461613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb5b39-0e23-41ab-8796-b9449cdb72c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.461967 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb5b39-0e23-41ab-8796-b9449cdb72c8 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.462750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb5b39-0e23-41ab-8796-b9449cdb72c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:13.463054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb5b39-0e23-41ab-8796-b9449cdb72c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:13.464630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb5b39-0e23-41ab-8796-b9449cdb72c8 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:13.482036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:13.492132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 213/432] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:13.497994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb5b39-0e23-41ab-8796-b9449cdb72c8 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:13.598525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d763c0-17b3-434a-99be-e666f5c23720 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:13.636882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb5b39-0e23-41ab-8796-b9449cdb72c8 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:13.639861 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2635b9-7c6a-42b3-a4d3-daea66901302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:13.640496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2635b9-7c6a-42b3-a4d3-daea66901302 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.640830 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2635b9-7c6a-42b3-a4d3-daea66901302 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.641105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2635b9-7c6a-42b3-a4d3-daea66901302 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.649605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2635b9-7c6a-42b3-a4d3-daea66901302 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:13.651373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2635b9-7c6a-42b3-a4d3-daea66901302 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-7b2635b9-7c6a-42b3-a4d3-daea66901302 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:13.662994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:13.663933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:13.664828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 220/433] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:37:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:13.666058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f5066-3c71-4022-aa89-abd4645cccfc None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.666058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f5066-3c71-4022-aa89-abd4645cccfc None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.666058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f5066-3c71-4022-aa89-abd4645cccfc None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.667141 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 221/434] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:13.667943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b1c60-fdf4-48f0-b37c-6f284ba25148 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.668217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b1c60-fdf4-48f0-b37c-6f284ba25148 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.668788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b1c60-fdf4-48f0-b37c-6f284ba25148 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.669692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 222/435] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:13.670373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b1c60-fdf4-48f0-b37c-6f284ba25148 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:13.680044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047931f-5dfd-4854-85a4-c3c36876a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:13.680943 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047931f-5dfd-4854-85a4-c3c36876a52b None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.681526 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047931f-5dfd-4854-85a4-c3c36876a52b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.681947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047931f-5dfd-4854-85a4-c3c36876a52b None admin] PATH_INFO: `/v3/users/nova` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.689447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047931f-5dfd-4854-85a4-c3c36876a52b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:13.690899 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047931f-5dfd-4854-85a4-c3c36876a52b None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-2047931f-5dfd-4854-85a4-c3c36876a52b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:13.704504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:13.705433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:13.706409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 214/436] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 04:37:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:13.707710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17164a-61fc-4e93-9eac-76838311fc53 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.707710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17164a-61fc-4e93-9eac-76838311fc53 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.707710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17164a-61fc-4e93-9eac-76838311fc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.726854 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-7c17164a-61fc-4e93-9eac-76838311fc53 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:13.728063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-7c17164a-61fc-4e93-9eac-76838311fc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:13.735747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:13.781523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b1c60-fdf4-48f0-b37c-6f284ba25148 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:13.782567 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:13.796697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 215/437] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:13.797920 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fca59-26cf-4e76-996e-d093d9324b4d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.798207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fca59-26cf-4e76-996e-d093d9324b4d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.798487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fca59-26cf-4e76-996e-d093d9324b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.814858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179d34f-d8bd-415a-9635-aca3ae3c5080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:13.815493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179d34f-d8bd-415a-9635-aca3ae3c5080 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:13.815776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179d34f-d8bd-415a-9635-aca3ae3c5080 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:13.816047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179d34f-d8bd-415a-9635-aca3ae3c5080 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:13.817341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179d34f-d8bd-415a-9635-aca3ae3c5080 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:13.817651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179d34f-d8bd-415a-9635-aca3ae3c5080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:13.819192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179d34f-d8bd-415a-9635-aca3ae3c5080 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:13.823719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-218fca59-26cf-4e76-996e-d093d9324b4d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:13.824984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-218fca59-26cf-4e76-996e-d093d9324b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:13.856515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 223/438] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 04:37:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:13.857758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179d34f-d8bd-415a-9635-aca3ae3c5080 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:13.898228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 216/439] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:13.899476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fca59-26cf-4e76-996e-d093d9324b4d None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:13.984352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179d34f-d8bd-415a-9635-aca3ae3c5080 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.000329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:14.017907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fca59-26cf-4e76-996e-d093d9324b4d None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.023336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfc4d9-e423-402e-b1b3-75e470b0ca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.024501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc4d9-e423-402e-b1b3-75e470b0ca5d None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.024973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc4d9-e423-402e-b1b3-75e470b0ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.025539 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc4d9-e423-402e-b1b3-75e470b0ca5d None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.026452 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfc4d9-e423-402e-b1b3-75e470b0ca5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:14.026950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfc4d9-e423-402e-b1b3-75e470b0ca5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:14.028768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfc4d9-e423-402e-b1b3-75e470b0ca5d None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:14.037280 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:14.051308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 224/440] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 04:37:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:14.052489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfc4d9-e423-402e-b1b3-75e470b0ca5d None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.056805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a8c4c-5efe-486b-ba0a-2a018c00af10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.057867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a8c4c-5efe-486b-ba0a-2a018c00af10 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.059681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a8c4c-5efe-486b-ba0a-2a018c00af10 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.059977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a8c4c-5efe-486b-ba0a-2a018c00af10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.072127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a8c4c-5efe-486b-ba0a-2a018c00af10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-2c9a8c4c-5efe-486b-ba0a-2a018c00af10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:14.077841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:14.078715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:14.079986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 217/441] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:14.080642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a8c4c-5efe-486b-ba0a-2a018c00af10 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.177250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfc4d9-e423-402e-b1b3-75e470b0ca5d None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.179169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a8c4c-5efe-486b-ba0a-2a018c00af10 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.210945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f804be7-a61c-4b05-8393-a83c8bfbd42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.211598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804be7-a61c-4b05-8393-a83c8bfbd42e None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.211877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804be7-a61c-4b05-8393-a83c8bfbd42e None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.212146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804be7-a61c-4b05-8393-a83c8bfbd42e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.212407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1de4e-c97a-4b04-8183-485ba1e36672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.213006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1de4e-c97a-4b04-8183-485ba1e36672 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.213288 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1de4e-c97a-4b04-8183-485ba1e36672 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.213563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1de4e-c97a-4b04-8183-485ba1e36672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.222098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f804be7-a61c-4b05-8393-a83c8bfbd42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:14.224135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f804be7-a61c-4b05-8393-a83c8bfbd42e None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-5f804be7-a61c-4b05-8393-a83c8bfbd42e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:14.239242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:14.240154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:14.240154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:14.240154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:14.240154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 225/442] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:14.241234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f804be7-a61c-4b05-8393-a83c8bfbd42e None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.263634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:14.265643 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:14.287607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1de4e-c97a-4b04-8183-485ba1e36672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:14.289485 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1de4e-c97a-4b04-8183-485ba1e36672 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:14.338509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f804be7-a61c-4b05-8393-a83c8bfbd42e None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.372008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b260-257d-415f-a7f1-ffc514e652d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.372632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b260-257d-415f-a7f1-ffc514e652d8 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.372912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b260-257d-415f-a7f1-ffc514e652d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.373189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b260-257d-415f-a7f1-ffc514e652d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.382808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328b260-257d-415f-a7f1-ffc514e652d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:14.384802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 218/443] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:37:14.385627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1de4e-c97a-4b04-8183-485ba1e36672 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-b328b260-257d-415f-a7f1-ffc514e652d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:14.387972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:14.388842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:14.389669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 226/444] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:14.390329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b260-257d-415f-a7f1-ffc514e652d8 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.465043 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:14.470302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:14.486413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b260-257d-415f-a7f1-ffc514e652d8 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.487729 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1de4e-c97a-4b04-8183-485ba1e36672 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.520656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658358-f35d-4142-af7b-9ab74550652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.521211 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658358-f35d-4142-af7b-9ab74550652e None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.521494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658358-f35d-4142-af7b-9ab74550652e None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.521614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fea70f-66ed-4844-86e3-38c22a4729ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.521770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658358-f35d-4142-af7b-9ab74550652e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.522217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea70f-66ed-4844-86e3-38c22a4729ac None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.522499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea70f-66ed-4844-86e3-38c22a4729ac None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.522776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea70f-66ed-4844-86e3-38c22a4729ac None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.523475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fea70f-66ed-4844-86e3-38c22a4729ac None admin] RBAC: Adding query filter params (name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:14.523780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fea70f-66ed-4844-86e3-38c22a4729ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:14.525144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fea70f-66ed-4844-86e3-38c22a4729ac None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:14.531740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a658358-f35d-4142-af7b-9ab74550652e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:14.532808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 219/445] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:14.533590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fea70f-66ed-4844-86e3-38c22a4729ac None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-4a658358-f35d-4142-af7b-9ab74550652e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:14.537059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:14.538002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:14.538826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 227/446] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:14.539510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658358-f35d-4142-af7b-9ab74550652e None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.634993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fea70f-66ed-4844-86e3-38c22a4729ac None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.638397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658358-f35d-4142-af7b-9ab74550652e None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.667752 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bfbcf-5fa9-414e-a149-df8d78335a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.668354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bfbcf-5fa9-414e-a149-df8d78335a2a None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.668633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bfbcf-5fa9-414e-a149-df8d78335a2a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.668911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bfbcf-5fa9-414e-a149-df8d78335a2a None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.669535 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bfbcf-5fa9-414e-a149-df8d78335a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:14.669837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bfbcf-5fa9-414e-a149-df8d78335a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:14.671101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fea79-47a9-4944-a494-c5637c68859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.671213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bfbcf-5fa9-414e-a149-df8d78335a2a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:14.671755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fea79-47a9-4944-a494-c5637c68859d None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.672037 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fea79-47a9-4944-a494-c5637c68859d None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.672311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fea79-47a9-4944-a494-c5637c68859d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.680349 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:14.683120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fea79-47a9-4944-a494-c5637c68859d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:14.683909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 220/447] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:14.684711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bfbcf-5fa9-414e-a149-df8d78335a2a None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.684811 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fea79-47a9-4944-a494-c5637c68859d None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:14.691014 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-c93fea79-47a9-4944-a494-c5637c68859d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:14.704048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:14.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:14.706034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:14.706034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:14.706034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:14.706034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 228/448] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:14.706034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fea79-47a9-4944-a494-c5637c68859d None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.788893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bfbcf-5fa9-414e-a149-df8d78335a2a None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.801491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fea79-47a9-4944-a494-c5637c68859d None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.822187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149b804-1450-49b1-b91f-c5f013e143f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.822788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149b804-1450-49b1-b91f-c5f013e143f1 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.823067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149b804-1450-49b1-b91f-c5f013e143f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.823370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149b804-1450-49b1-b91f-c5f013e143f1 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.824015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149b804-1450-49b1-b91f-c5f013e143f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:14.824320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149b804-1450-49b1-b91f-c5f013e143f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:14.825675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149b804-1450-49b1-b91f-c5f013e143f1 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:14.833767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 221/449] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:14.833965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de038e67-39c4-4118-9581-d11cdfb08a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.834541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149b804-1450-49b1-b91f-c5f013e143f1 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.834663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de038e67-39c4-4118-9581-d11cdfb08a20 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.834828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de038e67-39c4-4118-9581-d11cdfb08a20 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.835093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de038e67-39c4-4118-9581-d11cdfb08a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.848860 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de038e67-39c4-4118-9581-d11cdfb08a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:14.850336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de038e67-39c4-4118-9581-d11cdfb08a20 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-de038e67-39c4-4118-9581-d11cdfb08a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:14.864542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:14.865405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:14.866490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:14.866490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:14.866490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:14.866490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 229/450] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:14.866490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de038e67-39c4-4118-9581-d11cdfb08a20 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:14.901398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:14.913785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:14.939358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149b804-1450-49b1-b91f-c5f013e143f1 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.964207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de038e67-39c4-4118-9581-d11cdfb08a20 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:14.972363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364c9a-91d9-438f-aad5-35669afd2e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:14.972962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364c9a-91d9-438f-aad5-35669afd2e21 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:14.973243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364c9a-91d9-438f-aad5-35669afd2e21 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:14.973512 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364c9a-91d9-438f-aad5-35669afd2e21 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:14.974161 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c364c9a-91d9-438f-aad5-35669afd2e21 None admin] RBAC: Adding query filter params (name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:14.974466 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c364c9a-91d9-438f-aad5-35669afd2e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:14.975864 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c364c9a-91d9-438f-aad5-35669afd2e21 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:14.983675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 222/451] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:14.984458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364c9a-91d9-438f-aad5-35669afd2e21 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.000083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5c485-19b8-4c6f-b3c3-ecedecefedf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.000719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5c485-19b8-4c6f-b3c3-ecedecefedf4 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.001002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5c485-19b8-4c6f-b3c3-ecedecefedf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.001281 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5c485-19b8-4c6f-b3c3-ecedecefedf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.008389 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5c485-19b8-4c6f-b3c3-ecedecefedf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.009836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5c485-19b8-4c6f-b3c3-ecedecefedf4 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-45d5c485-19b8-4c6f-b3c3-ecedecefedf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:15.020879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:15.021772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:15.022608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:15.022608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:15.022608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:15.022608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:15.022608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:15.022608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:15.022608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:15.022608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:15.022608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 230/452] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:15.023229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5c485-19b8-4c6f-b3c3-ecedecefedf4 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.085727 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364c9a-91d9-438f-aad5-35669afd2e21 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.108149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:15.119436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63761b2e-7eb5-4f5f-a3b3-a69060976fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.120216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63761b2e-7eb5-4f5f-a3b3-a69060976fd5 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.120494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63761b2e-7eb5-4f5f-a3b3-a69060976fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.120768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63761b2e-7eb5-4f5f-a3b3-a69060976fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.121401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63761b2e-7eb5-4f5f-a3b3-a69060976fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:15.121699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63761b2e-7eb5-4f5f-a3b3-a69060976fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.123071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63761b2e-7eb5-4f5f-a3b3-a69060976fd5 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.124313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5c485-19b8-4c6f-b3c3-ecedecefedf4 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.133518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:15.135745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 223/453] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:15.136533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63761b2e-7eb5-4f5f-a3b3-a69060976fd5 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.158710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a3f78-7ae2-41ce-a914-e15e3ad32798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.159363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3f78-7ae2-41ce-a914-e15e3ad32798 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.159656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3f78-7ae2-41ce-a914-e15e3ad32798 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.159936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3f78-7ae2-41ce-a914-e15e3ad32798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.170819 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a3f78-7ae2-41ce-a914-e15e3ad32798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.172355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a3f78-7ae2-41ce-a914-e15e3ad32798 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-206a3f78-7ae2-41ce-a914-e15e3ad32798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:15.186579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:15.187610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:15.188460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:15.188460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:15.188460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:15.188460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 231/454] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:15.189043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a3f78-7ae2-41ce-a914-e15e3ad32798 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.244200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63761b2e-7eb5-4f5f-a3b3-a69060976fd5 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.277255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263303ea-615f-4521-9886-a85286d94d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.277850 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263303ea-615f-4521-9886-a85286d94d35 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.278128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263303ea-615f-4521-9886-a85286d94d35 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.278400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263303ea-615f-4521-9886-a85286d94d35 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.279027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263303ea-615f-4521-9886-a85286d94d35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:15.279354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263303ea-615f-4521-9886-a85286d94d35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.280720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263303ea-615f-4521-9886-a85286d94d35 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.286161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a3f78-7ae2-41ce-a914-e15e3ad32798 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.292123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 224/455] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:15.293055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263303ea-615f-4521-9886-a85286d94d35 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.322856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fdd69-4c91-41e8-883d-43fbe0722269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.323511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fdd69-4c91-41e8-883d-43fbe0722269 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.323794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fdd69-4c91-41e8-883d-43fbe0722269 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.324069 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fdd69-4c91-41e8-883d-43fbe0722269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.334851 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fdd69-4c91-41e8-883d-43fbe0722269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.336386 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fdd69-4c91-41e8-883d-43fbe0722269 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.337332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-7a4fdd69-4c91-41e8-883d-43fbe0722269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:15.350989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:15.351906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:15.352747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:15.352747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:15.352747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:15.352747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 232/456] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:15.352965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fdd69-4c91-41e8-883d-43fbe0722269 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.370485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:15.395317 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263303ea-615f-4521-9886-a85286d94d35 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.428304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd075af3-a32d-4473-b616-bd537b27c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.428902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd075af3-a32d-4473-b616-bd537b27c621 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.429183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd075af3-a32d-4473-b616-bd537b27c621 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.429450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd075af3-a32d-4473-b616-bd537b27c621 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.430118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd075af3-a32d-4473-b616-bd537b27c621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:15.430426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd075af3-a32d-4473-b616-bd537b27c621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.431869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd075af3-a32d-4473-b616-bd537b27c621 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.443910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 225/457] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:15.448919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd075af3-a32d-4473-b616-bd537b27c621 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.453219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fdd69-4c91-41e8-883d-43fbe0722269 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.486210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a53a6d-82da-4194-b9ee-7c728d7586ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.486841 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a53a6d-82da-4194-b9ee-7c728d7586ee None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.487117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a53a6d-82da-4194-b9ee-7c728d7586ee None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.487425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a53a6d-82da-4194-b9ee-7c728d7586ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.494591 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a53a6d-82da-4194-b9ee-7c728d7586ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.496079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a53a6d-82da-4194-b9ee-7c728d7586ee None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-f5a53a6d-82da-4194-b9ee-7c728d7586ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:15.507103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:15.507968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:15.508824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:15.508824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:15.508824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:15.508824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:15.508824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:15.508824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:15.508824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:15.508824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:15.508824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 233/458] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:15.509294 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a53a6d-82da-4194-b9ee-7c728d7586ee None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.551164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd075af3-a32d-4473-b616-bd537b27c621 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.553488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:15.578731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:15.586246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d0582-eb70-4cbc-8ad9-944144b9514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.586919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d0582-eb70-4cbc-8ad9-944144b9514d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.587147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d0582-eb70-4cbc-8ad9-944144b9514d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.587454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d0582-eb70-4cbc-8ad9-944144b9514d None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.588133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d0582-eb70-4cbc-8ad9-944144b9514d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:15.588439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d0582-eb70-4cbc-8ad9-944144b9514d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.590070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d0582-eb70-4cbc-8ad9-944144b9514d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.601249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 226/459] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:15.602035 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d0582-eb70-4cbc-8ad9-944144b9514d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.612568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a53a6d-82da-4194-b9ee-7c728d7586ee None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.646227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37380513-b044-4b51-b2c2-55b3841ad75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.646857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37380513-b044-4b51-b2c2-55b3841ad75c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.647142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37380513-b044-4b51-b2c2-55b3841ad75c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.647462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37380513-b044-4b51-b2c2-55b3841ad75c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.654567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37380513-b044-4b51-b2c2-55b3841ad75c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.656043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37380513-b044-4b51-b2c2-55b3841ad75c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-37380513-b044-4b51-b2c2-55b3841ad75c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:15.666932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:15.667887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 234/460] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:15.673677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37380513-b044-4b51-b2c2-55b3841ad75c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.701234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d0582-eb70-4cbc-8ad9-944144b9514d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.734648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d908-3fb6-412e-b2a8-5a599a48505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.735249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d908-3fb6-412e-b2a8-5a599a48505c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.735561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d908-3fb6-412e-b2a8-5a599a48505c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.735838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d908-3fb6-412e-b2a8-5a599a48505c None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.736474 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7d908-3fb6-412e-b2a8-5a599a48505c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:15.736779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7d908-3fb6-412e-b2a8-5a599a48505c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.738164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7d908-3fb6-412e-b2a8-5a599a48505c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.749469 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 227/461] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:15.750262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d908-3fb6-412e-b2a8-5a599a48505c None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.764720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37380513-b044-4b51-b2c2-55b3841ad75c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.776932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:15.793319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:15.798364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38ec64-990d-4d26-a05f-b6c332c3d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.799015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38ec64-990d-4d26-a05f-b6c332c3d8f0 None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.799305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38ec64-990d-4d26-a05f-b6c332c3d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.799584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38ec64-990d-4d26-a05f-b6c332c3d8f0 None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/bf5efddd82994140a5f07c926375d477/roles/bb0934f87e1f44729e10e428242ea249` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.813815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38ec64-990d-4d26-a05f-b6c332c3d8f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=bf5efddd82994140a5f07c926375d477, role_id=bb0934f87e1f44729e10e428242ea249)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.815243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38ec64-990d-4d26-a05f-b6c332c3d8f0 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.827339 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 235/462] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:37:15 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/bf5efddd82994140a5f07c926375d477/roles/bb0934f87e1f44729e10e428242ea249 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:37:15.831497 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38ec64-990d-4d26-a05f-b6c332c3d8f0 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.867242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d908-3fb6-412e-b2a8-5a599a48505c None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.906962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5099be-f82e-4503-8617-4ba846e6e9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.908481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5099be-f82e-4503-8617-4ba846e6e9be None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.908768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5099be-f82e-4503-8617-4ba846e6e9be None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.909046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5099be-f82e-4503-8617-4ba846e6e9be None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:15.909871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5099be-f82e-4503-8617-4ba846e6e9be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:15.910744 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5099be-f82e-4503-8617-4ba846e6e9be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:15.912293 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5099be-f82e-4503-8617-4ba846e6e9be None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:15.926435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 228/463] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:15.927324 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5099be-f82e-4503-8617-4ba846e6e9be None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:15.951766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38ec64-990d-4d26-a05f-b6c332c3d8f0 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:15.990966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601251cb-3bf1-48ae-a303-af8b06a10e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:15.991664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601251cb-3bf1-48ae-a303-af8b06a10e45 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:15.991956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601251cb-3bf1-48ae-a303-af8b06a10e45 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:15.992262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601251cb-3bf1-48ae-a303-af8b06a10e45 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:16.001360 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601251cb-3bf1-48ae-a303-af8b06a10e45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:16.002801 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601251cb-3bf1-48ae-a303-af8b06a10e45 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-601251cb-3bf1-48ae-a303-af8b06a10e45 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:16.015117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:16.016104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:16.016992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 236/464] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:16.017548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601251cb-3bf1-48ae-a303-af8b06a10e45 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:16.030321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:16.047314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5099be-f82e-4503-8617-4ba846e6e9be None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:16.065562 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:16.084967 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc88a-6cfc-43e9-8cfd-0847a35fd5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:16.085577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc88a-6cfc-43e9-8cfd-0847a35fd5e6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:16.085855 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc88a-6cfc-43e9-8cfd-0847a35fd5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:16.086381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc88a-6cfc-43e9-8cfd-0847a35fd5e6 None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:16.086979 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cc88a-6cfc-43e9-8cfd-0847a35fd5e6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:16.087432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cc88a-6cfc-43e9-8cfd-0847a35fd5e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:16.088845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cc88a-6cfc-43e9-8cfd-0847a35fd5e6 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:16.111440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 229/465] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Oct 12 04:37:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:16.112666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc88a-6cfc-43e9-8cfd-0847a35fd5e6 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:16.124965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601251cb-3bf1-48ae-a303-af8b06a10e45 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:16.160095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ed4d1-ccdd-47fc-a3eb-a0f5f7ff3a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:16.160722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ed4d1-ccdd-47fc-a3eb-a0f5f7ff3a1e None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:16.161003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ed4d1-ccdd-47fc-a3eb-a0f5f7ff3a1e None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:16.161276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ed4d1-ccdd-47fc-a3eb-a0f5f7ff3a1e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:16.168725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ed4d1-ccdd-47fc-a3eb-a0f5f7ff3a1e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:16.170171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ed4d1-ccdd-47fc-a3eb-a0f5f7ff3a1e None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-574ed4d1-ccdd-47fc-a3eb-a0f5f7ff3a1e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:16.181366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:16.182263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:16.183180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 237/466] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:16.184432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ed4d1-ccdd-47fc-a3eb-a0f5f7ff3a1e None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:16.224229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc88a-6cfc-43e9-8cfd-0847a35fd5e6 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:16.261461 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e82b6-13e6-4556-b0a4-d784d79decb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:16.262067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e82b6-13e6-4556-b0a4-d784d79decb9 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:16.262347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e82b6-13e6-4556-b0a4-d784d79decb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:16.262618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e82b6-13e6-4556-b0a4-d784d79decb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:16.263370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e82b6-13e6-4556-b0a4-d784d79decb9 None admin] RBAC: Adding query filter params (role.id=bb0934f87e1f44729e10e428242ea249, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=7e02bef3699b4569986b36cec686931a) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:16.264085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e82b6-13e6-4556-b0a4-d784d79decb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:16.265900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e82b6-13e6-4556-b0a4-d784d79decb9 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:16.283322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 230/467] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:37:16 2022] GET /identity/v3/role_assignments?user.id=7e02bef3699b4569986b36cec686931a&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=bb0934f87e1f44729e10e428242ea249 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:16.283322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e82b6-13e6-4556-b0a4-d784d79decb9 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:16.293485 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:16.304788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ed4d1-ccdd-47fc-a3eb-a0f5f7ff3a1e None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:16.322736 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:16.354702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908248a9-82d0-48de-82b4-7c561db03078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:16.355352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908248a9-82d0-48de-82b4-7c561db03078 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:16.355637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908248a9-82d0-48de-82b4-7c561db03078 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:16.355909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908248a9-82d0-48de-82b4-7c561db03078 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:16.356815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908248a9-82d0-48de-82b4-7c561db03078 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:16.357124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908248a9-82d0-48de-82b4-7c561db03078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:16.358695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908248a9-82d0-48de-82b4-7c561db03078 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:16.384748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 238/468] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Oct 12 04:37:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:16.385913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908248a9-82d0-48de-82b4-7c561db03078 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:16.402346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e82b6-13e6-4556-b0a4-d784d79decb9 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:16.444225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04080ed2-98ec-4bee-8940-6bedf7b6dd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:16.444845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04080ed2-98ec-4bee-8940-6bedf7b6dd58 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:16.445123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04080ed2-98ec-4bee-8940-6bedf7b6dd58 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:16.445393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04080ed2-98ec-4bee-8940-6bedf7b6dd58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:16.508687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908248a9-82d0-48de-82b4-7c561db03078 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:16.534859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04080ed2-98ec-4bee-8940-6bedf7b6dd58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:16.536357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04080ed2-98ec-4bee-8940-6bedf7b6dd58 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:16.546624 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:16.548401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cc24e-1aee-4992-bfb7-4b1bef4629c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:16.550047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cc24e-1aee-4992-bfb7-4b1bef4629c4 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:16.550335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cc24e-1aee-4992-bfb7-4b1bef4629c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:16.551134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cc24e-1aee-4992-bfb7-4b1bef4629c4 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:16.552312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cc24e-1aee-4992-bfb7-4b1bef4629c4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:16.552901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cc24e-1aee-4992-bfb7-4b1bef4629c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:16.557122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cc24e-1aee-4992-bfb7-4b1bef4629c4 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:16.584236 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 239/469] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Oct 12 04:37:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:16.585249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cc24e-1aee-4992-bfb7-4b1bef4629c4 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:16.654124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:16.657192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 231/470] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:37:16.658175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04080ed2-98ec-4bee-8940-6bedf7b6dd58 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:16.720413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cc24e-1aee-4992-bfb7-4b1bef4629c4 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:16.767835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388c56-391e-49a8-8b4f-d5c8dad67337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:16.768974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388c56-391e-49a8-8b4f-d5c8dad67337 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:16.769435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388c56-391e-49a8-8b4f-d5c8dad67337 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:16.769716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388c56-391e-49a8-8b4f-d5c8dad67337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:16.774133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04080ed2-98ec-4bee-8940-6bedf7b6dd58 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:16.782129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:16.811467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78833c0c-bc77-4c68-8cdd-d39897c8688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:16.812262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78833c0c-bc77-4c68-8cdd-d39897c8688b None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:16.812614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78833c0c-bc77-4c68-8cdd-d39897c8688b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:16.812973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78833c0c-bc77-4c68-8cdd-d39897c8688b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:16.865466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9388c56-391e-49a8-8b4f-d5c8dad67337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:16.867944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9388c56-391e-49a8-8b4f-d5c8dad67337 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:16.888926 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78833c0c-bc77-4c68-8cdd-d39897c8688b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:16.889663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:16.890617 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78833c0c-bc77-4c68-8cdd-d39897c8688b None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:16.975320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 240/471] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:37:16.976397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388c56-391e-49a8-8b4f-d5c8dad67337 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.002240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 232/472] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:37:17.003101 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78833c0c-bc77-4c68-8cdd-d39897c8688b None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.012142 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:17.080474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388c56-391e-49a8-8b4f-d5c8dad67337 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:17.100244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:17.106742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78833c0c-bc77-4c68-8cdd-d39897c8688b None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:17.119099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d62cf9-a066-478f-9d0d-be53163efb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:17.120149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62cf9-a066-478f-9d0d-be53163efb60 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:17.120648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62cf9-a066-478f-9d0d-be53163efb60 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:17.121129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62cf9-a066-478f-9d0d-be53163efb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:17.131654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d62cf9-a066-478f-9d0d-be53163efb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:17.133792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d62cf9-a066-478f-9d0d-be53163efb60 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:17.143108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab7838-0703-4f41-92a9-5614d5b08971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:17.143804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab7838-0703-4f41-92a9-5614d5b08971 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:17.144054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab7838-0703-4f41-92a9-5614d5b08971 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:17.144867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab7838-0703-4f41-92a9-5614d5b08971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-88d62cf9-a066-478f-9d0d-be53163efb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:17.150077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:17.150952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:17.151831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:17.151831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:17.151831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:17.153820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 241/473] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:17.154802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d62cf9-a066-478f-9d0d-be53163efb60 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.155549 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab7838-0703-4f41-92a9-5614d5b08971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:17.157002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab7838-0703-4f41-92a9-5614d5b08971 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-e9ab7838-0703-4f41-92a9-5614d5b08971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:17.172160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:17.173085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:17.173941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:17.173941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:17.173941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:17.178253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 233/474] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:17.179083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab7838-0703-4f41-92a9-5614d5b08971 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.239348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:17.261402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d62cf9-a066-478f-9d0d-be53163efb60 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:17.284556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab7838-0703-4f41-92a9-5614d5b08971 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:17.298836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470d904-bcd2-4aa6-9107-18adff7f01a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:17.299930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470d904-bcd2-4aa6-9107-18adff7f01a5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:17.300988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470d904-bcd2-4aa6-9107-18adff7f01a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:17.301460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470d904-bcd2-4aa6-9107-18adff7f01a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:17.311838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470d904-bcd2-4aa6-9107-18adff7f01a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:17.313507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470d904-bcd2-4aa6-9107-18adff7f01a5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:17.320296 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a9ab-0043-4237-9ec0-240f6444ea44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:17.320905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a9ab-0043-4237-9ec0-240f6444ea44 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:17.321184 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a9ab-0043-4237-9ec0-240f6444ea44 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:17.321457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a9ab-0043-4237-9ec0-240f6444ea44 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:17.322322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9a9ab-0043-4237-9ec0-240f6444ea44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:17.322452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9a9ab-0043-4237-9ec0-240f6444ea44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:17.323751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9a9ab-0043-4237-9ec0-240f6444ea44 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-f470d904-bcd2-4aa6-9107-18adff7f01a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:17.330454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:17.331373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:17.332743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:17.332743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:17.332743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:17.334434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 242/475] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:17.335428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470d904-bcd2-4aa6-9107-18adff7f01a5 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.341408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 234/476] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:17.343058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a9ab-0043-4237-9ec0-240f6444ea44 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.371730 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:17.446059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a9ab-0043-4237-9ec0-240f6444ea44 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:17.459925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470d904-bcd2-4aa6-9107-18adff7f01a5 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:17.464935 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:17.484648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d55a-155c-4566-b447-0c9d62d6986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:17.485539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d55a-155c-4566-b447-0c9d62d6986e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:17.486028 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d55a-155c-4566-b447-0c9d62d6986e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:17.486524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d55a-155c-4566-b447-0c9d62d6986e None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:17.487475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23d55a-155c-4566-b447-0c9d62d6986e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:17.488100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23d55a-155c-4566-b447-0c9d62d6986e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:17.489728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23d55a-155c-4566-b447-0c9d62d6986e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:17.501401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d81de-aca0-40e6-b79e-a9cba3f8fc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:17.502014 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d81de-aca0-40e6-b79e-a9cba3f8fc88 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:17.502297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d81de-aca0-40e6-b79e-a9cba3f8fc88 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:17.502574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d81de-aca0-40e6-b79e-a9cba3f8fc88 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:17.503212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d81de-aca0-40e6-b79e-a9cba3f8fc88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:17.504063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d81de-aca0-40e6-b79e-a9cba3f8fc88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:17.508813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d81de-aca0-40e6-b79e-a9cba3f8fc88 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:17.509123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 235/477] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:17.510198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d55a-155c-4566-b447-0c9d62d6986e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.522488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 243/478] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:17.522488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d81de-aca0-40e6-b79e-a9cba3f8fc88 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.615751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:17.634312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d81de-aca0-40e6-b79e-a9cba3f8fc88 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:17.639150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d55a-155c-4566-b447-0c9d62d6986e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:17.669134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484386-cd32-4f2f-9b1b-3cb3d60eec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:17.669863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484386-cd32-4f2f-9b1b-3cb3d60eec85 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:17.670212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484386-cd32-4f2f-9b1b-3cb3d60eec85 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:17.670563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484386-cd32-4f2f-9b1b-3cb3d60eec85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:17.677064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa4aa-4d3c-4068-a6f0-aeca3898d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:17.677920 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa4aa-4d3c-4068-a6f0-aeca3898d6ed None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:17.678373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa4aa-4d3c-4068-a6f0-aeca3898d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:17.678493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75484386-cd32-4f2f-9b1b-3cb3d60eec85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:17.679016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa4aa-4d3c-4068-a6f0-aeca3898d6ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:17.680274 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75484386-cd32-4f2f-9b1b-3cb3d60eec85 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:17.686751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fa4aa-4d3c-4068-a6f0-aeca3898d6ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:17.688518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fa4aa-4d3c-4068-a6f0-aeca3898d6ed None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-75484386-cd32-4f2f-9b1b-3cb3d60eec85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:17.692973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:17.693807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:17.695047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:17.695047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:17.695047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:17.695047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:17.695047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:17.695047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:17.695047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:17.695047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:17.695047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 244/479] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:17.695707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484386-cd32-4f2f-9b1b-3cb3d60eec85 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-409fa4aa-4d3c-4068-a6f0-aeca3898d6ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:17.704523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:17.705381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:17.706253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:17.706253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:17.706253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:17.706253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:17.706253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:17.706253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:17.706253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:17.706253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:17.708818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 236/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:17.713830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa4aa-4d3c-4068-a6f0-aeca3898d6ed None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.758339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:17.802164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484386-cd32-4f2f-9b1b-3cb3d60eec85 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:17.824565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa4aa-4d3c-4068-a6f0-aeca3898d6ed None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:17.838185 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c04407-9449-42d4-bf23-bd65e709fa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:17.839021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c04407-9449-42d4-bf23-bd65e709fa26 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:17.839568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c04407-9449-42d4-bf23-bd65e709fa26 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:17.840260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c04407-9449-42d4-bf23-bd65e709fa26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:17.847783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c04407-9449-42d4-bf23-bd65e709fa26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:17.849386 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c04407-9449-42d4-bf23-bd65e709fa26 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-b3c04407-9449-42d4-bf23-bd65e709fa26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:17.862002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:17.863569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:17.864395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:17.864395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:17.864395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:17.864395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:17.864395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:17.864395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:17.864395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:17.864395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:17.864795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec8a88-07b8-4ef5-bde4-66c98f988fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:17.864795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec8a88-07b8-4ef5-bde4-66c98f988fbb None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:17.864795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec8a88-07b8-4ef5-bde4-66c98f988fbb None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:17.864795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec8a88-07b8-4ef5-bde4-66c98f988fbb None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:17.865053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec8a88-07b8-4ef5-bde4-66c98f988fbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:17.865762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec8a88-07b8-4ef5-bde4-66c98f988fbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:17.867228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 245/481] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:17.868209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c04407-9449-42d4-bf23-bd65e709fa26 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.871949 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:17.872994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec8a88-07b8-4ef5-bde4-66c98f988fbb None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:17.888434 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 237/482] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:17.889639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec8a88-07b8-4ef5-bde4-66c98f988fbb None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:17.979017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c04407-9449-42d4-bf23-bd65e709fa26 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:18.014519 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dd841-6740-44b5-bd9d-1d24bd88faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:18.015201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dd841-6740-44b5-bd9d-1d24bd88faeb None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:18.015609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dd841-6740-44b5-bd9d-1d24bd88faeb None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:18.015982 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dd841-6740-44b5-bd9d-1d24bd88faeb None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:18.016772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dd841-6740-44b5-bd9d-1d24bd88faeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:18.017179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dd841-6740-44b5-bd9d-1d24bd88faeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:18.018729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dd841-6740-44b5-bd9d-1d24bd88faeb None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:18.027805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:18.031905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec8a88-07b8-4ef5-bde4-66c98f988fbb None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:18.032041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 246/483] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:18.032883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dd841-6740-44b5-bd9d-1d24bd88faeb None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:18.073467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b80d-03ed-430b-a736-002f4fb66e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:18.074083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b80d-03ed-430b-a736-002f4fb66e07 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:18.074629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b80d-03ed-430b-a736-002f4fb66e07 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:18.074629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b80d-03ed-430b-a736-002f4fb66e07 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:18.075325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b80d-03ed-430b-a736-002f4fb66e07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:18.075633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b80d-03ed-430b-a736-002f4fb66e07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:18.077093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411b80d-03ed-430b-a736-002f4fb66e07 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:18.094057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 238/484] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:18.094057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2036bf-f834-4366-90d9-50c904021723 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:18.094057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2036bf-f834-4366-90d9-50c904021723 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:18.094057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2036bf-f834-4366-90d9-50c904021723 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:18.094057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 239/485] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:18.094057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2036bf-f834-4366-90d9-50c904021723 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:18.105932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:18.145966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dd841-6740-44b5-bd9d-1d24bd88faeb None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:18.181832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646263d8-3398-434d-b43b-9369bf53d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:18.182710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646263d8-3398-434d-b43b-9369bf53d0da None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:18.182997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646263d8-3398-434d-b43b-9369bf53d0da None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:18.183268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646263d8-3398-434d-b43b-9369bf53d0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:18.184011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646263d8-3398-434d-b43b-9369bf53d0da None admin] RBAC: Adding query filter params (role.id=bb0934f87e1f44729e10e428242ea249, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=946db23ba1fe47999ae12f8380f4c48a) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:18.184316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646263d8-3398-434d-b43b-9369bf53d0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:18.185723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646263d8-3398-434d-b43b-9369bf53d0da None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:18.193165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 247/486] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:37:18 2022] GET /identity/v3/role_assignments?user.id=946db23ba1fe47999ae12f8380f4c48a&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=bb0934f87e1f44729e10e428242ea249 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:18.194188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646263d8-3398-434d-b43b-9369bf53d0da None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:18.202321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2036bf-f834-4366-90d9-50c904021723 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:18.242961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554928d-351f-4067-b639-e8a9b11ad373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:18.243894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554928d-351f-4067-b639-e8a9b11ad373 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:18.244346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554928d-351f-4067-b639-e8a9b11ad373 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:18.244788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554928d-351f-4067-b639-e8a9b11ad373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:18.245723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554928d-351f-4067-b639-e8a9b11ad373 None admin] RBAC: Adding query filter params (role.id=bb0934f87e1f44729e10e428242ea249, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=dc59d3cc1fbc4d4382bffd8ae93075e1) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:18.246218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554928d-351f-4067-b639-e8a9b11ad373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:18.247997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554928d-351f-4067-b639-e8a9b11ad373 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:18.263589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 240/487] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:37:18 2022] GET /identity/v3/role_assignments?user.id=dc59d3cc1fbc4d4382bffd8ae93075e1&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=bb0934f87e1f44729e10e428242ea249 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:18.265646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db4cf5-0a27-4bf6-8bbf-84a7c8f4f114 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:18.266133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db4cf5-0a27-4bf6-8bbf-84a7c8f4f114 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:18.266577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db4cf5-0a27-4bf6-8bbf-84a7c8f4f114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:18.312506 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-44db4cf5-0a27-4bf6-8bbf-84a7c8f4f114 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:18.314031 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-44db4cf5-0a27-4bf6-8bbf-84a7c8f4f114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:18.324566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646263d8-3398-434d-b43b-9369bf53d0da None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:18.333860 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:18.385302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:18.394553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 241/488] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:18.413641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da263e-07b0-49d4-b8d6-92a3a8c695a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:18.414282 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da263e-07b0-49d4-b8d6-92a3a8c695a3 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:18.414570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da263e-07b0-49d4-b8d6-92a3a8c695a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:18.414848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da263e-07b0-49d4-b8d6-92a3a8c695a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:18.415628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da263e-07b0-49d4-b8d6-92a3a8c695a3 None admin] RBAC: Adding query filter params (role.id=bb0934f87e1f44729e10e428242ea249, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=c894579b2b2943409412afbbfe779aa4) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:18.415948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da263e-07b0-49d4-b8d6-92a3a8c695a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:18.417415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da263e-07b0-49d4-b8d6-92a3a8c695a3 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:18.428789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 248/489] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:37:18 2022] GET /identity/v3/role_assignments?user.id=c894579b2b2943409412afbbfe779aa4&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=bb0934f87e1f44729e10e428242ea249 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:18.610457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb350dd-009b-4660-8c87-360baf1538b5 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:18.610781 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb350dd-009b-4660-8c87-360baf1538b5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:18.611011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb350dd-009b-4660-8c87-360baf1538b5 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:18.612441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 242/490] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:18.618991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3d038-e664-4ad3-919c-28b02252f88e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:18.619300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3d038-e664-4ad3-919c-28b02252f88e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:18.619586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3d038-e664-4ad3-919c-28b02252f88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:18.638215 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2cc3d038-e664-4ad3-919c-28b02252f88e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:18.639512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2cc3d038-e664-4ad3-919c-28b02252f88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:18.697048 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb350dd-009b-4660-8c87-360baf1538b5 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:18.715356 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 249/491] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:18.823563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb350dd-009b-4660-8c87-360baf1538b5 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:18.866078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d8899-c881-4dac-b531-c025a4efe7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:18.867038 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d8899-c881-4dac-b531-c025a4efe7d4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:18.867562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d8899-c881-4dac-b531-c025a4efe7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:18.868034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d8899-c881-4dac-b531-c025a4efe7d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:18.884675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d8899-c881-4dac-b531-c025a4efe7d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-872d8899-c881-4dac-b531-c025a4efe7d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:18.889969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:18.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:18.891677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:18.894723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 243/492] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:18.900833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3d038-e664-4ad3-919c-28b02252f88e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:19.006709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3d038-e664-4ad3-919c-28b02252f88e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:19.030177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:19.048514 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d8899-c881-4dac-b531-c025a4efe7d4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:19.052805 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31466-6759-471a-b6ba-8a385e91eae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:19.053433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31466-6759-471a-b6ba-8a385e91eae1 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:19.054597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31466-6759-471a-b6ba-8a385e91eae1 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:19.054899 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31466-6759-471a-b6ba-8a385e91eae1 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:19.055606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31466-6759-471a-b6ba-8a385e91eae1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:19.055916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31466-6759-471a-b6ba-8a385e91eae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:19.057313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31466-6759-471a-b6ba-8a385e91eae1 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:19.067704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 250/493] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:19.073824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31466-6759-471a-b6ba-8a385e91eae1 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:19.079641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:19.187978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31466-6759-471a-b6ba-8a385e91eae1 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:19.259012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d8899-c881-4dac-b531-c025a4efe7d4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:19.282646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d454f72-8cb1-4e5f-8944-e1623f4fa76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:19.283318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d454f72-8cb1-4e5f-8944-e1623f4fa76c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:19.283609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d454f72-8cb1-4e5f-8944-e1623f4fa76c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:19.283885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d454f72-8cb1-4e5f-8944-e1623f4fa76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:19.302205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b39b6a-ada2-4ed0-82d0-eb67719b63f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:19.303234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39b6a-ada2-4ed0-82d0-eb67719b63f6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:19.304216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39b6a-ada2-4ed0-82d0-eb67719b63f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:19.304715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39b6a-ada2-4ed0-82d0-eb67719b63f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:19.309184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d454f72-8cb1-4e5f-8944-e1623f4fa76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:19.310709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d454f72-8cb1-4e5f-8944-e1623f4fa76c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:19.316564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b39b6a-ada2-4ed0-82d0-eb67719b63f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-71b39b6a-ada2-4ed0-82d0-eb67719b63f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:19.322725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:19.324137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:37:19.325091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:19.327686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 244/494] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:37:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-6d454f72-8cb1-4e5f-8944-e1623f4fa76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:19.334397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:19.335336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:19.336216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:19.336216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:19.336216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:19.337628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b39b6a-ada2-4ed0-82d0-eb67719b63f6 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:19.339396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 251/495] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:19.345063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d454f72-8cb1-4e5f-8944-e1623f4fa76c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:19.413598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:19.428483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:19.463069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b39b6a-ada2-4ed0-82d0-eb67719b63f6 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:19.499867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75515c8-e365-416c-9b72-7bc3363c98e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:19.501005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75515c8-e365-416c-9b72-7bc3363c98e8 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:19.501546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75515c8-e365-416c-9b72-7bc3363c98e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:19.502142 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75515c8-e365-416c-9b72-7bc3363c98e8 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:19.503325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75515c8-e365-416c-9b72-7bc3363c98e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:19.503905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75515c8-e365-416c-9b72-7bc3363c98e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:19.505508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75515c8-e365-416c-9b72-7bc3363c98e8 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:19.518389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 245/496] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:19.524560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75515c8-e365-416c-9b72-7bc3363c98e8 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:19.575583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d454f72-8cb1-4e5f-8944-e1623f4fa76c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:19.647987 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1344a-e2b7-4a5c-a6fe-26089ddf0ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:19.648603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1344a-e2b7-4a5c-a6fe-26089ddf0ac4 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:19.648882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1344a-e2b7-4a5c-a6fe-26089ddf0ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:19.649159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1344a-e2b7-4a5c-a6fe-26089ddf0ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:19.649799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1344a-e2b7-4a5c-a6fe-26089ddf0ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:19.650099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1344a-e2b7-4a5c-a6fe-26089ddf0ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:19.651502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1344a-e2b7-4a5c-a6fe-26089ddf0ac4 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:19.664995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75515c8-e365-416c-9b72-7bc3363c98e8 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:19.685197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 252/497] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:19.703830 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1344a-e2b7-4a5c-a6fe-26089ddf0ac4 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:19.709984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f3f5f-ded7-49d9-a79c-c1ca9a470290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:19.710637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f3f5f-ded7-49d9-a79c-c1ca9a470290 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:19.710916 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f3f5f-ded7-49d9-a79c-c1ca9a470290 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:19.711186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f3f5f-ded7-49d9-a79c-c1ca9a470290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:19.715632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:19.733288 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f3f5f-ded7-49d9-a79c-c1ca9a470290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:19.734751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f3f5f-ded7-49d9-a79c-c1ca9a470290 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-be1f3f5f-ded7-49d9-a79c-c1ca9a470290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:19.764229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:19.765269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:19.766126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:19.766126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:19.766126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:19.766300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 246/498] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:19.776571 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f3f5f-ded7-49d9-a79c-c1ca9a470290 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:19.871850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:19.881763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1344a-e2b7-4a5c-a6fe-26089ddf0ac4 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:19.919572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a6d51-ced3-448d-a4cf-d9e6e5493317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:19.920936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6d51-ced3-448d-a4cf-d9e6e5493317 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:19.921417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6d51-ced3-448d-a4cf-d9e6e5493317 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:19.921960 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a6d51-ced3-448d-a4cf-d9e6e5493317 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:19.930800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a6d51-ced3-448d-a4cf-d9e6e5493317 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:19.932446 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a6d51-ced3-448d-a4cf-d9e6e5493317 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-bb1a6d51-ced3-448d-a4cf-d9e6e5493317 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:19.946041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:19.947150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:19.948301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:19.948301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:19.948301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:19.948301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:19.948301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:19.948301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:19.948301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:19.948301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:19.948301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 04:37:19.948301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:19.951440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 253/499] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:37:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:19.957340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a6d51-ced3-448d-a4cf-d9e6e5493317 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:19.995076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f3f5f-ded7-49d9-a79c-c1ca9a470290 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:20.075448 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e5c99-dcf9-43b9-ae25-76a49d54b8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:20.076071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e5c99-dcf9-43b9-ae25-76a49d54b8cf None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:20.076347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e5c99-dcf9-43b9-ae25-76a49d54b8cf None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:20.076620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e5c99-dcf9-43b9-ae25-76a49d54b8cf None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:20.077266 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e5c99-dcf9-43b9-ae25-76a49d54b8cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:20.077573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e5c99-dcf9-43b9-ae25-76a49d54b8cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:20.079671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e5c99-dcf9-43b9-ae25-76a49d54b8cf None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:20.095752 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a6d51-ced3-448d-a4cf-d9e6e5493317 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:20.110953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 247/500] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:20.115611 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e5c99-dcf9-43b9-ae25-76a49d54b8cf None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:20.161158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6671383-94eb-442c-b3af-b9b5e8ad17e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:20.161782 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6671383-94eb-442c-b3af-b9b5e8ad17e1 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:20.162062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6671383-94eb-442c-b3af-b9b5e8ad17e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:20.162339 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6671383-94eb-442c-b3af-b9b5e8ad17e1 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:20.163073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6671383-94eb-442c-b3af-b9b5e8ad17e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:20.163404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6671383-94eb-442c-b3af-b9b5e8ad17e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:20.165487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6671383-94eb-442c-b3af-b9b5e8ad17e1 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:20.185552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 254/501] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 04:37:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:20.195329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6671383-94eb-442c-b3af-b9b5e8ad17e1 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:20.216215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:20.218640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:20.298735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e5c99-dcf9-43b9-ae25-76a49d54b8cf None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:20.334961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7871fbd-b00c-46da-b271-ac34aec60ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:20.335747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7871fbd-b00c-46da-b271-ac34aec60ea4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:20.336034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7871fbd-b00c-46da-b271-ac34aec60ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:20.336316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7871fbd-b00c-46da-b271-ac34aec60ea4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:20.353196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7871fbd-b00c-46da-b271-ac34aec60ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:20.354658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7871fbd-b00c-46da-b271-ac34aec60ea4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-c7871fbd-b00c-46da-b271-ac34aec60ea4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:20.372939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:20.374009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:20.374994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:20.374994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:20.374994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:20.374994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:20.374994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:20.374994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:20.374994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:20.374994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:20.374994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:37:20.374994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:20.380402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 248/502] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 04:37:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:20.386329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7871fbd-b00c-46da-b271-ac34aec60ea4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:20.406297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6671383-94eb-442c-b3af-b9b5e8ad17e1 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:20.446476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e675a4f-4eec-4799-89e9-ceec98008863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:20.447390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e675a4f-4eec-4799-89e9-ceec98008863 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:20.447679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e675a4f-4eec-4799-89e9-ceec98008863 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:20.447954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e675a4f-4eec-4799-89e9-ceec98008863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:20.554820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7871fbd-b00c-46da-b271-ac34aec60ea4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:20.567923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:20.573483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e675a4f-4eec-4799-89e9-ceec98008863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:20.574959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e675a4f-4eec-4799-89e9-ceec98008863 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:20.602952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:20.627734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822aabe-bace-4704-b2e0-62e1d19ed91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:20.628848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822aabe-bace-4704-b2e0-62e1d19ed91a None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:20.630223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822aabe-bace-4704-b2e0-62e1d19ed91a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:20.630498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822aabe-bace-4704-b2e0-62e1d19ed91a None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:20.631228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822aabe-bace-4704-b2e0-62e1d19ed91a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:20.631555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822aabe-bace-4704-b2e0-62e1d19ed91a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:20.632974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822aabe-bace-4704-b2e0-62e1d19ed91a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:20.664259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 249/503] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 04:37:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:20.670074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822aabe-bace-4704-b2e0-62e1d19ed91a None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:20.749033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 255/504] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:37:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 04:37:20.750784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb77c38-d651-4109-8447-f946cbe18276 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:20.751071 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb77c38-d651-4109-8447-f946cbe18276 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:20.751782 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb77c38-d651-4109-8447-f946cbe18276 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:20.758089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 256/505] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:20.758957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb77c38-d651-4109-8447-f946cbe18276 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:20.793222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822aabe-bace-4704-b2e0-62e1d19ed91a None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:20.830130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb7526-fae1-4628-8def-d21a46229b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:20.830686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7526-fae1-4628-8def-d21a46229b7c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:20.830969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7526-fae1-4628-8def-d21a46229b7c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:20.831241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7526-fae1-4628-8def-d21a46229b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:20.845411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb7526-fae1-4628-8def-d21a46229b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:20.847774 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb7526-fae1-4628-8def-d21a46229b7c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-b6cb7526-fae1-4628-8def-d21a46229b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:20.866115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:20.867125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:20.868060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:20.868060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:20.868060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:20.868673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 250/506] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:20.872428 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf081d-8273-4209-8edb-0eb43bb9e674 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:20.872927 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf081d-8273-4209-8edb-0eb43bb9e674 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:20.873388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf081d-8273-4209-8edb-0eb43bb9e674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:20.885720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb77c38-d651-4109-8447-f946cbe18276 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:20.894625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-4ecf081d-8273-4209-8edb-0eb43bb9e674 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:20.896513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4ecf081d-8273-4209-8edb-0eb43bb9e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:20.901994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:20.910923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:20.936015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d63fd9-04b6-4617-be47-99338ed637cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:20.936970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d63fd9-04b6-4617-be47-99338ed637cf None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:20.937255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d63fd9-04b6-4617-be47-99338ed637cf None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:20.937528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d63fd9-04b6-4617-be47-99338ed637cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:20.951504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d63fd9-04b6-4617-be47-99338ed637cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:20.953732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d63fd9-04b6-4617-be47-99338ed637cf None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-63d63fd9-04b6-4617-be47-99338ed637cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:20.975628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:20.976619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:20.977479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:20.977479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:20.977479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:20.977479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 257/507] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:20.978141 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d63fd9-04b6-4617-be47-99338ed637cf None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:20.983874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 251/508] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:20.984937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf081d-8273-4209-8edb-0eb43bb9e674 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.122704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf081d-8273-4209-8edb-0eb43bb9e674 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:21.122895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d63fd9-04b6-4617-be47-99338ed637cf None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:21.164267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2a7cb-a215-4249-939c-4a9df533d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:21.165223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2a7cb-a215-4249-939c-4a9df533d8ba None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.165720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2a7cb-a215-4249-939c-4a9df533d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.166210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2a7cb-a215-4249-939c-4a9df533d8ba None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.167035 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2a7cb-a215-4249-939c-4a9df533d8ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:21.167401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1051f8a-af16-40c9-9d10-3a7094659025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:21.167889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2a7cb-a215-4249-939c-4a9df533d8ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:21.167991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1051f8a-af16-40c9-9d10-3a7094659025 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.168286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1051f8a-af16-40c9-9d10-3a7094659025 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.168564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1051f8a-af16-40c9-9d10-3a7094659025 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.169205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1051f8a-af16-40c9-9d10-3a7094659025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:21.169513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1051f8a-af16-40c9-9d10-3a7094659025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:21.170353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2a7cb-a215-4249-939c-4a9df533d8ba None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:21.170874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1051f8a-af16-40c9-9d10-3a7094659025 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:21.182662 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 258/509] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:21.183992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 252/510] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:21.184562 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a822-bc1d-427d-8387-c1a1e968b377 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.185055 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a822-bc1d-427d-8387-c1a1e968b377 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.185517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a822-bc1d-427d-8387-c1a1e968b377 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.186926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 259/511] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:21.188585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e97297-bab8-437c-8cc8-b29c41537ebf None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.188873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e97297-bab8-437c-8cc8-b29c41537ebf None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.189173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e97297-bab8-437c-8cc8-b29c41537ebf None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.190533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 253/512] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:21.195045 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a822-bc1d-427d-8387-c1a1e968b377 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.195175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e97297-bab8-437c-8cc8-b29c41537ebf None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.203524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:21.221313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:21.302996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a822-bc1d-427d-8387-c1a1e968b377 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:21.304401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e97297-bab8-437c-8cc8-b29c41537ebf None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:21.336849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c537-ef46-4c15-b5df-ae3bc1a7854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:21.337022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9dd88-c7be-4f1c-a330-9c9d045c0f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:21.337476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c537-ef46-4c15-b5df-ae3bc1a7854c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.337582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9dd88-c7be-4f1c-a330-9c9d045c0f0c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.337758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c537-ef46-4c15-b5df-ae3bc1a7854c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.337861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9dd88-c7be-4f1c-a330-9c9d045c0f0c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.338033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c537-ef46-4c15-b5df-ae3bc1a7854c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.338143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9dd88-c7be-4f1c-a330-9c9d045c0f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.344813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879c537-ef46-4c15-b5df-ae3bc1a7854c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:21.345105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9dd88-c7be-4f1c-a330-9c9d045c0f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:21.346255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879c537-ef46-4c15-b5df-ae3bc1a7854c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:21.346511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9dd88-c7be-4f1c-a330-9c9d045c0f0c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-9879c537-ef46-4c15-b5df-ae3bc1a7854c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:21.357796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:21.358707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:21.365003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:21.365003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:21.365003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:21.365003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:21.365003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:21.365003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:21.365003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:21.365003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-02b9dd88-c7be-4f1c-a330-9c9d045c0f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:21.365464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:21.366253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:21.367114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:21.367114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:21.367114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:21.367114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:21.367114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:21.367114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:21.367114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:21.367114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:21.367560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 260/513] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:21.367629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 254/514] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:21.367695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0095-27fd-4949-b217-6ec85c6ac281 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.367695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0095-27fd-4949-b217-6ec85c6ac281 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.367695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0095-27fd-4949-b217-6ec85c6ac281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.367886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b162118-87a3-4587-be45-122385701cb0 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.367886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b162118-87a3-4587-be45-122385701cb0 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.367886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b162118-87a3-4587-be45-122385701cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.379774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-ca0a0095-27fd-4949-b217-6ec85c6ac281 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:21.380008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-4b162118-87a3-4587-be45-122385701cb0 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:21.380913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ca0a0095-27fd-4949-b217-6ec85c6ac281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:21.381179 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4b162118-87a3-4587-be45-122385701cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:21.439441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:21.446798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 261/515] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:21.456997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 255/516] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:21.457129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a0095-27fd-4949-b217-6ec85c6ac281 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.457228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b162118-87a3-4587-be45-122385701cb0 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.472883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:21.558639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b162118-87a3-4587-be45-122385701cb0 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:21.561192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a0095-27fd-4949-b217-6ec85c6ac281 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:21.596583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6280fd-4eed-4c77-822c-125b57d15ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:21.597578 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6280fd-4eed-4c77-822c-125b57d15ef7 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.597961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6280fd-4eed-4c77-822c-125b57d15ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.598339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6280fd-4eed-4c77-822c-125b57d15ef7 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.599133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6280fd-4eed-4c77-822c-125b57d15ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:21.599608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6280fd-4eed-4c77-822c-125b57d15ef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:21.600791 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27776-4e84-4c28-98de-ef47b1a7eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:21.601237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6280fd-4eed-4c77-822c-125b57d15ef7 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:21.601812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27776-4e84-4c28-98de-ef47b1a7eef5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.602234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27776-4e84-4c28-98de-ef47b1a7eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.602646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27776-4e84-4c28-98de-ef47b1a7eef5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.603507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a27776-4e84-4c28-98de-ef47b1a7eef5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:21.605140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a27776-4e84-4c28-98de-ef47b1a7eef5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:21.619083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 256/517] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:21.619083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6280fd-4eed-4c77-822c-125b57d15ef7 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-88a27776-4e84-4c28-98de-ef47b1a7eef5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:21.622353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:21.623390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 04:37:21.624227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:21.627024 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 262/518] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Oct 12 04:37:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:21.628160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27776-4e84-4c28-98de-ef47b1a7eef5 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.680399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:21.716558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:21.727541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6280fd-4eed-4c77-822c-125b57d15ef7 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:21.739365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27776-4e84-4c28-98de-ef47b1a7eef5 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:21.761377 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa186d8d-4d33-43c1-bea1-4088208908ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:21.761986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa186d8d-4d33-43c1-bea1-4088208908ca None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.762263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa186d8d-4d33-43c1-bea1-4088208908ca None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.762533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa186d8d-4d33-43c1-bea1-4088208908ca None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.763211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa186d8d-4d33-43c1-bea1-4088208908ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:21.763545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa186d8d-4d33-43c1-bea1-4088208908ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:21.764959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa186d8d-4d33-43c1-bea1-4088208908ca None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:21.772437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2701ef8-1b35-4e7c-952c-a14876cbc705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:21.773037 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701ef8-1b35-4e7c-952c-a14876cbc705 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.773320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701ef8-1b35-4e7c-952c-a14876cbc705 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.773600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701ef8-1b35-4e7c-952c-a14876cbc705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.774316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2701ef8-1b35-4e7c-952c-a14876cbc705 None admin] RBAC: Adding query filter params (role.id=bb0934f87e1f44729e10e428242ea249, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=bf5efddd82994140a5f07c926375d477) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:21.774623 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2701ef8-1b35-4e7c-952c-a14876cbc705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:21.776054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2701ef8-1b35-4e7c-952c-a14876cbc705 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:21.776638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 257/519] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:21.781497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa186d8d-4d33-43c1-bea1-4088208908ca None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.789625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 263/520] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:37:21 2022] GET /identity/v3/role_assignments?user.id=bf5efddd82994140a5f07c926375d477&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=bb0934f87e1f44729e10e428242ea249 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:21.789625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2701ef8-1b35-4e7c-952c-a14876cbc705 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.895250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa186d8d-4d33-43c1-bea1-4088208908ca None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:21.896464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2701ef8-1b35-4e7c-952c-a14876cbc705 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:21.915836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:21.936397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a9e28-d604-4338-80a5-14da48f0aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:21.936943 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9e28-d604-4338-80a5-14da48f0aff2 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.937229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9e28-d604-4338-80a5-14da48f0aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.937505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9e28-d604-4338-80a5-14da48f0aff2 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.938146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a9e28-d604-4338-80a5-14da48f0aff2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:21.938453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a9e28-d604-4338-80a5-14da48f0aff2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:21.939881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a9e28-d604-4338-80a5-14da48f0aff2 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:21.940240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8119cb-91d1-4472-84af-b30d547ef645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:21.941433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8119cb-91d1-4472-84af-b30d547ef645 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:21.941719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8119cb-91d1-4472-84af-b30d547ef645 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:21.941994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8119cb-91d1-4472-84af-b30d547ef645 None admin] PATH_INFO: `/v3/services/network` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:21.942577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8119cb-91d1-4472-84af-b30d547ef645 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:21.943996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8119cb-91d1-4472-84af-b30d547ef645 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:21.945552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 258/521] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 04:37:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:21.946413 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a9e28-d604-4338-80a5-14da48f0aff2 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-4b8119cb-91d1-4472-84af-b30d547ef645 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:21.953243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:21.954224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:21.955062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 264/522] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:21 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:21.955918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8119cb-91d1-4472-84af-b30d547ef645 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:21.965635 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:22.060987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a9e28-d604-4338-80a5-14da48f0aff2 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:22.069424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8119cb-91d1-4472-84af-b30d547ef645 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:22.098480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd68782-232c-499f-bbbd-9956d1b702f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:22.099113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68782-232c-499f-bbbd-9956d1b702f2 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:22.099425 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68782-232c-499f-bbbd-9956d1b702f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:22.099706 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68782-232c-499f-bbbd-9956d1b702f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:22.105108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e415d8f-73f1-4e16-9b06-083e2ee6e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:22.105773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e415d8f-73f1-4e16-9b06-083e2ee6e9f4 None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:22.106114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e415d8f-73f1-4e16-9b06-083e2ee6e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:22.106816 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e415d8f-73f1-4e16-9b06-083e2ee6e9f4 None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/7e02bef3699b4569986b36cec686931a/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:22.109183 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e415d8f-73f1-4e16-9b06-083e2ee6e9f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=7e02bef3699b4569986b36cec686931a, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:22.109815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd68782-232c-499f-bbbd-9956d1b702f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:22.110631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e415d8f-73f1-4e16-9b06-083e2ee6e9f4 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:22.111233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd68782-232c-499f-bbbd-9956d1b702f2 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:22.124354 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 265/523] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:37:21 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/7e02bef3699b4569986b36cec686931a/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:37:22.125485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e415d8f-73f1-4e16-9b06-083e2ee6e9f4 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-edd68782-232c-499f-bbbd-9956d1b702f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:22.126540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:22.127508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:22.129096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:22.129096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:22.129096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:22.129096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 259/524] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:22.129803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd68782-232c-499f-bbbd-9956d1b702f2 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:22.171201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:22.229186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:22.255665 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd68782-232c-499f-bbbd-9956d1b702f2 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:22.280894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e415d8f-73f1-4e16-9b06-083e2ee6e9f4 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:22.301522 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107749a7-fe96-49be-bfbf-defbe8e366c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:22.302238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107749a7-fe96-49be-bfbf-defbe8e366c9 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:22.302523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107749a7-fe96-49be-bfbf-defbe8e366c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:22.302797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107749a7-fe96-49be-bfbf-defbe8e366c9 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:22.303491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107749a7-fe96-49be-bfbf-defbe8e366c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:22.303803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107749a7-fe96-49be-bfbf-defbe8e366c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:22.305955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107749a7-fe96-49be-bfbf-defbe8e366c9 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:22.315452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 260/525] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:22.316699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107749a7-fe96-49be-bfbf-defbe8e366c9 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:22.327859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5df2a-08bc-43da-8d2e-282a3ce06fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:22.328481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5df2a-08bc-43da-8d2e-282a3ce06fc3 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:22.328760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5df2a-08bc-43da-8d2e-282a3ce06fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:22.329091 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5df2a-08bc-43da-8d2e-282a3ce06fc3 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:22.329718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5df2a-08bc-43da-8d2e-282a3ce06fc3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:22.330989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5df2a-08bc-43da-8d2e-282a3ce06fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:22.333004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5df2a-08bc-43da-8d2e-282a3ce06fc3 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:22.338935 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 266/526] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 04:37:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:22.340037 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5df2a-08bc-43da-8d2e-282a3ce06fc3 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:22.435222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:22.443167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107749a7-fe96-49be-bfbf-defbe8e366c9 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:22.485079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5df2a-08bc-43da-8d2e-282a3ce06fc3 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:22.486220 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dfdb2-4da3-4ad5-ab5b-7fb432d06ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:22.487342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dfdb2-4da3-4ad5-ab5b-7fb432d06ce9 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:22.488372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dfdb2-4da3-4ad5-ab5b-7fb432d06ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:22.488825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dfdb2-4da3-4ad5-ab5b-7fb432d06ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:22.489662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dfdb2-4da3-4ad5-ab5b-7fb432d06ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:22.490158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dfdb2-4da3-4ad5-ab5b-7fb432d06ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:22.491765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dfdb2-4da3-4ad5-ab5b-7fb432d06ce9 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:22.507417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 261/527] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:22.512608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dfdb2-4da3-4ad5-ab5b-7fb432d06ce9 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:22.565418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:22.582201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93769f-a560-4918-a964-d1562980fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:22.582531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93769f-a560-4918-a964-d1562980fd66 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:22.583959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93769f-a560-4918-a964-d1562980fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:22.584250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93769f-a560-4918-a964-d1562980fd66 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:22.585174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93769f-a560-4918-a964-d1562980fd66 None admin] RBAC: Adding query filter params (type=network) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:22.585490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93769f-a560-4918-a964-d1562980fd66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:22.587052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93769f-a560-4918-a964-d1562980fd66 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:22.594039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 267/528] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:22.645326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dfdb2-4da3-4ad5-ab5b-7fb432d06ce9 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:22.685004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7eff7-9461-4c11-92f7-faa61bd08b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:22.685631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7eff7-9461-4c11-92f7-faa61bd08b8f None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:22.685917 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7eff7-9461-4c11-92f7-faa61bd08b8f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:22.686190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7eff7-9461-4c11-92f7-faa61bd08b8f None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:22.686847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7eff7-9461-4c11-92f7-faa61bd08b8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:22.688369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7eff7-9461-4c11-92f7-faa61bd08b8f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:22.713819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 262/529] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:37:22 2022] POST /identity/v3/users => generated 254 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:37:24.268658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc628-f071-4ddf-9296-1ced75231796 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:24.269299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc628-f071-4ddf-9296-1ced75231796 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:24.269299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc628-f071-4ddf-9296-1ced75231796 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:24.270884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 268/530] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:24.276025 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e2ac-5a1b-4447-a0d8-f921e2333fcb None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:24.276427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e2ac-5a1b-4447-a0d8-f921e2333fcb None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:24.276590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e2ac-5a1b-4447-a0d8-f921e2333fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:24.299432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-cf53e2ac-5a1b-4447-a0d8-f921e2333fcb None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:24.300657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-cf53e2ac-5a1b-4447-a0d8-f921e2333fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:24.308660 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:24.393868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 263/531] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:24.723532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bc628-f071-4ddf-9296-1ced75231796 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:24.854950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bc628-f071-4ddf-9296-1ced75231796 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:24.889974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51d71-729a-48fb-9d8f-0878753b2890 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:24.890296 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51d71-729a-48fb-9d8f-0878753b2890 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:24.890588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51d71-729a-48fb-9d8f-0878753b2890 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:24.892173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 264/532] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:24.897583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d06300-226f-44b3-aaec-7f53ea3add48 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:24.897864 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d06300-226f-44b3-aaec-7f53ea3add48 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:24.898135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d06300-226f-44b3-aaec-7f53ea3add48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:24.919780 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f64f8-5433-4ee0-a582-1c71e2899f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:24.920419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f64f8-5433-4ee0-a582-1c71e2899f00 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:24.920760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f64f8-5433-4ee0-a582-1c71e2899f00 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:24.921040 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f64f8-5433-4ee0-a582-1c71e2899f00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:24.922252 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-f0d06300-226f-44b3-aaec-7f53ea3add48 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:24.923461 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f0d06300-226f-44b3-aaec-7f53ea3add48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:24.943548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f64f8-5433-4ee0-a582-1c71e2899f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-861f64f8-5433-4ee0-a582-1c71e2899f00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:24.948351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:24.949314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:37:24.950154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:24.956354 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 269/533] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:24.957200 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f64f8-5433-4ee0-a582-1c71e2899f00 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:25.052953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 265/534] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:37:25.070002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:25.146455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f64f8-5433-4ee0-a582-1c71e2899f00 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:25.184383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34d7df-9853-4984-bbff-09a0808345d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:25.184996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d7df-9853-4984-bbff-09a0808345d3 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.185273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d7df-9853-4984-bbff-09a0808345d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.185546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d7df-9853-4984-bbff-09a0808345d3 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.186201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34d7df-9853-4984-bbff-09a0808345d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:25.186573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34d7df-9853-4984-bbff-09a0808345d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:25.187957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34d7df-9853-4984-bbff-09a0808345d3 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:25.197178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 270/535] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:25.202525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d06300-226f-44b3-aaec-7f53ea3add48 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:25.253914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb004ca-921d-48b9-a6f1-24d9a6a380e2 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.254475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb004ca-921d-48b9-a6f1-24d9a6a380e2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.254926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb004ca-921d-48b9-a6f1-24d9a6a380e2 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.256527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 271/536] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:25.261693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97f0f7-6baf-48b7-9458-d4c55a8e9809 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.261981 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97f0f7-6baf-48b7-9458-d4c55a8e9809 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.262260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97f0f7-6baf-48b7-9458-d4c55a8e9809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.287808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-9f97f0f7-6baf-48b7-9458-d4c55a8e9809 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:25.289144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9f97f0f7-6baf-48b7-9458-d4c55a8e9809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:25.304677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:25.338202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d06300-226f-44b3-aaec-7f53ea3add48 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:25.376126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de352e5-49bb-46ca-9af7-7390a78a0d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:25.376767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de352e5-49bb-46ca-9af7-7390a78a0d3c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.377053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de352e5-49bb-46ca-9af7-7390a78a0d3c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.377330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de352e5-49bb-46ca-9af7-7390a78a0d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.377743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 272/537] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 04:37:25.380604 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079d89b-286c-4586-a1d3-30f49e41ced9 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.380893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079d89b-286c-4586-a1d3-30f49e41ced9 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.381165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079d89b-286c-4586-a1d3-30f49e41ced9 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.382548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 273/538] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:25.383926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079d89b-286c-4586-a1d3-30f49e41ced9 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:25.396061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de352e5-49bb-46ca-9af7-7390a78a0d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:25.398247 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de352e5-49bb-46ca-9af7-7390a78a0d3c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-0de352e5-49bb-46ca-9af7-7390a78a0d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:25.417700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:25.418650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:25.419647 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:25.419647 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:25.419647 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:25.420931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 266/539] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:25.422344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa255e-7032-4c17-983b-4173057692f6 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.422636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa255e-7032-4c17-983b-4173057692f6 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.422913 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa255e-7032-4c17-983b-4173057692f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.442818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b1aa255e-7032-4c17-983b-4173057692f6 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:25.443723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:25.445299 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b1aa255e-7032-4c17-983b-4173057692f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:25.514471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079d89b-286c-4586-a1d3-30f49e41ced9 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:25.531157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 267/540] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:25.532180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa255e-7032-4c17-983b-4173057692f6 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:25.560555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6c9f2-c278-4c13-b55a-298197ea3945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:25.561562 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6c9f2-c278-4c13-b55a-298197ea3945 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.562059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6c9f2-c278-4c13-b55a-298197ea3945 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.562541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6c9f2-c278-4c13-b55a-298197ea3945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.578759 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6c9f2-c278-4c13-b55a-298197ea3945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-1ae6c9f2-c278-4c13-b55a-298197ea3945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:25.584740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:25.585677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:37:25.586514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:25.589275 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 274/541] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:37:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:25.599315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6c9f2-c278-4c13-b55a-298197ea3945 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:25.621806 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:25.671521 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa255e-7032-4c17-983b-4173057692f6 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:25.709892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb4c7a-8f5c-4c02-8c8a-20ed67d12279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:25.710851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb4c7a-8f5c-4c02-8c8a-20ed67d12279 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.711767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb4c7a-8f5c-4c02-8c8a-20ed67d12279 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.712231 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb4c7a-8f5c-4c02-8c8a-20ed67d12279 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.713325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb4c7a-8f5c-4c02-8c8a-20ed67d12279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:25.713824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb4c7a-8f5c-4c02-8c8a-20ed67d12279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:25.715556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb4c7a-8f5c-4c02-8c8a-20ed67d12279 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:25.724401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6c9f2-c278-4c13-b55a-298197ea3945 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:25.729321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 268/542] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:25.730523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3d753-8f37-403c-9b47-f849d9190466 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.730810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3d753-8f37-403c-9b47-f849d9190466 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.731089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3d753-8f37-403c-9b47-f849d9190466 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.732838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:25.736176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 269/543] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:25.736988 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3d753-8f37-403c-9b47-f849d9190466 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:25.762990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154b0dd-205c-419f-a658-cf63ebc82dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:25.763622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b0dd-205c-419f-a658-cf63ebc82dff None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.763905 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b0dd-205c-419f-a658-cf63ebc82dff None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.764178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b0dd-205c-419f-a658-cf63ebc82dff None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.764829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154b0dd-205c-419f-a658-cf63ebc82dff None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:25.765130 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154b0dd-205c-419f-a658-cf63ebc82dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:25.766490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154b0dd-205c-419f-a658-cf63ebc82dff None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:25.774703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 275/544] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:37:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:25.775501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154b0dd-205c-419f-a658-cf63ebc82dff None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:25.852893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3d753-8f37-403c-9b47-f849d9190466 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:25.867361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:25.877955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154b0dd-205c-419f-a658-cf63ebc82dff None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:25.887611 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd88d67-60be-44e0-98d4-a04f3da1e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:25.888251 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd88d67-60be-44e0-98d4-a04f3da1e055 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.888532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd88d67-60be-44e0-98d4-a04f3da1e055 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.888809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd88d67-60be-44e0-98d4-a04f3da1e055 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.889460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd88d67-60be-44e0-98d4-a04f3da1e055 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:25.890823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd88d67-60be-44e0-98d4-a04f3da1e055 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:25.906631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 270/545] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:37:25 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:25.908713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14637-900a-48a0-a31a-1d92eb752242 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.909191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14637-900a-48a0-a31a-1d92eb752242 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.910022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14637-900a-48a0-a31a-1d92eb752242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.918190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ac6b0-2ed5-44d0-8865-898d85841cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:25.919148 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ac6b0-2ed5-44d0-8865-898d85841cdf None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:25.919611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ac6b0-2ed5-44d0-8865-898d85841cdf None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:25.920035 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ac6b0-2ed5-44d0-8865-898d85841cdf None admin] PATH_INFO: `/v3/users/swift` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:25.930232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ac6b0-2ed5-44d0-8865-898d85841cdf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:25.930569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0fa14637-900a-48a0-a31a-1d92eb752242 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:25.931845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0fa14637-900a-48a0-a31a-1d92eb752242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:25.932334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ac6b0-2ed5-44d0-8865-898d85841cdf None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-5d5ac6b0-2ed5-44d0-8865-898d85841cdf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:25.945034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:25.946230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:25.947363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:25.947363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:25.947363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:25.947363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:25.947363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:25.947363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:25.947363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:25.947363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:25.947363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 04:37:25.947363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:25.948633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 276/546] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:37:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:25.949495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ac6b0-2ed5-44d0-8865-898d85841cdf None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:25.978582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:26.027122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 271/547] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 04:37:26.028258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa14637-900a-48a0-a31a-1d92eb752242 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:26.072488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ac6b0-2ed5-44d0-8865-898d85841cdf None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:26.119166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff50f-480d-4c5e-8923-6ad61c3a4567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:26.120070 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff50f-480d-4c5e-8923-6ad61c3a4567 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:26.120353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff50f-480d-4c5e-8923-6ad61c3a4567 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:26.120629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff50f-480d-4c5e-8923-6ad61c3a4567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:26.133382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fff50f-480d-4c5e-8923-6ad61c3a4567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:26.134837 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fff50f-480d-4c5e-8923-6ad61c3a4567 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-a4fff50f-480d-4c5e-8923-6ad61c3a4567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:26.151708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:26.152658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:26.153517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:26.153517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:26.153517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:26.153517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 277/548] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:26.154015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff50f-480d-4c5e-8923-6ad61c3a4567 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:26.162474 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa14637-900a-48a0-a31a-1d92eb752242 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:26.165634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:26.206147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e9563-8458-4cd5-bf7e-1d5162273f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:26.207119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e9563-8458-4cd5-bf7e-1d5162273f3b None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:26.207577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e9563-8458-4cd5-bf7e-1d5162273f3b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:26.207985 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e9563-8458-4cd5-bf7e-1d5162273f3b None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:26.208800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e9563-8458-4cd5-bf7e-1d5162273f3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:26.210344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e9563-8458-4cd5-bf7e-1d5162273f3b None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:26.230775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 272/549] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:37:26 2022] POST /identity/v3/services => generated 240 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:26.236098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e9563-8458-4cd5-bf7e-1d5162273f3b None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:26.261515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:26.302623 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff50f-480d-4c5e-8923-6ad61c3a4567 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:26.355188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f0061-3648-4917-a697-59b012ee60cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:26.355853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f0061-3648-4917-a697-59b012ee60cd None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:26.356140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f0061-3648-4917-a697-59b012ee60cd None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:26.356418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f0061-3648-4917-a697-59b012ee60cd None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:26.357720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f0061-3648-4917-a697-59b012ee60cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:26.358035 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f0061-3648-4917-a697-59b012ee60cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:26.360362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f0061-3648-4917-a697-59b012ee60cd None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:26.385399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 278/550] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 04:37:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:26.385735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e9563-8458-4cd5-bf7e-1d5162273f3b None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:26.388393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f0061-3648-4917-a697-59b012ee60cd None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:26.427675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e87d-a3cd-4136-8304-58816018da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:26.428502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e87d-a3cd-4136-8304-58816018da12 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:26.428801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e87d-a3cd-4136-8304-58816018da12 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:26.429129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e87d-a3cd-4136-8304-58816018da12 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:26.429800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8e87d-a3cd-4136-8304-58816018da12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:26.430115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8e87d-a3cd-4136-8304-58816018da12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:26.431792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8e87d-a3cd-4136-8304-58816018da12 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:26.447419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 273/551] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:26.448232 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e87d-a3cd-4136-8304-58816018da12 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:26.480765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:26.528087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f0061-3648-4917-a697-59b012ee60cd None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:26.563384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:26.569501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6b8d9-1b43-404a-b531-5a7eb059cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:26.571209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6b8d9-1b43-404a-b531-5a7eb059cc58 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:26.571674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6b8d9-1b43-404a-b531-5a7eb059cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:26.572343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6b8d9-1b43-404a-b531-5a7eb059cc58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:26.579634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e87d-a3cd-4136-8304-58816018da12 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:26.587524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6b8d9-1b43-404a-b531-5a7eb059cc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-22b6b8d9-1b43-404a-b531-5a7eb059cc58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:26.594800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:26.595976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:26.597067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:26.599568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 279/552] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:26.600505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6b8d9-1b43-404a-b531-5a7eb059cc58 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:26.630446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8517b0-545f-4466-b8c2-92be9b35fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:26.631026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8517b0-545f-4466-b8c2-92be9b35fa0b None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:26.631390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8517b0-545f-4466-b8c2-92be9b35fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:26.631973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8517b0-545f-4466-b8c2-92be9b35fa0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:26.643150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8517b0-545f-4466-b8c2-92be9b35fa0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:26.644851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8517b0-545f-4466-b8c2-92be9b35fa0b None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-cc8517b0-545f-4466-b8c2-92be9b35fa0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:26.661786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:26.663014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:26.664218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:26.664218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:26.664218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:26.664218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 274/553] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:26.664218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8517b0-545f-4466-b8c2-92be9b35fa0b None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:26.734207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6b8d9-1b43-404a-b531-5a7eb059cc58 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:26.752859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:26.778688 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8517b0-545f-4466-b8c2-92be9b35fa0b None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:26.780855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aa6b6-d424-4f04-b72a-adbbca0300f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:26.781740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aa6b6-d424-4f04-b72a-adbbca0300f4 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:26.782175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aa6b6-d424-4f04-b72a-adbbca0300f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:26.782612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aa6b6-d424-4f04-b72a-adbbca0300f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:26.791083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aa6b6-d424-4f04-b72a-adbbca0300f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:26.792878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aa6b6-d424-4f04-b72a-adbbca0300f4 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-8b8aa6b6-d424-4f04-b72a-adbbca0300f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:26.805974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:26.807137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:37:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:26.810183 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 280/554] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 04:37:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:26.811095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aa6b6-d424-4f04-b72a-adbbca0300f4 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:26.814390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042538b5-67d5-4c91-a9b6-2460da396017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:26.815639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042538b5-67d5-4c91-a9b6-2460da396017 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:26.815639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042538b5-67d5-4c91-a9b6-2460da396017 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:26.815856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042538b5-67d5-4c91-a9b6-2460da396017 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:26.816491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042538b5-67d5-4c91-a9b6-2460da396017 None admin] RBAC: Adding query filter params (name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:26.816849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042538b5-67d5-4c91-a9b6-2460da396017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:26.818262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042538b5-67d5-4c91-a9b6-2460da396017 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:26.827957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 275/555] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:26.829039 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042538b5-67d5-4c91-a9b6-2460da396017 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:26.866264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:26.923434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aa6b6-d424-4f04-b72a-adbbca0300f4 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:26.941064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042538b5-67d5-4c91-a9b6-2460da396017 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:26.960799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c544ad-0995-4c08-9882-44977d04675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:26.961705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c544ad-0995-4c08-9882-44977d04675f None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:26.962293 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c544ad-0995-4c08-9882-44977d04675f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:26.962774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c544ad-0995-4c08-9882-44977d04675f None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:26.963656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c544ad-0995-4c08-9882-44977d04675f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:26.964166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c544ad-0995-4c08-9882-44977d04675f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:26.966250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c544ad-0995-4c08-9882-44977d04675f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:26.977017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f0dbd-848d-4b64-80a4-5b0a1eb745ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:26.977614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f0dbd-848d-4b64-80a4-5b0a1eb745ff None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:26.977898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f0dbd-848d-4b64-80a4-5b0a1eb745ff None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:26.978176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f0dbd-848d-4b64-80a4-5b0a1eb745ff None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:26.978881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f0dbd-848d-4b64-80a4-5b0a1eb745ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:26.979185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f0dbd-848d-4b64-80a4-5b0a1eb745ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:26.980686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f0dbd-848d-4b64-80a4-5b0a1eb745ff None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:26.981134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 281/556] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:26.982264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c544ad-0995-4c08-9882-44977d04675f None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:26.990335 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:27.000941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 276/557] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 04:37:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:27.001809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f0dbd-848d-4b64-80a4-5b0a1eb745ff None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:27.091697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c544ad-0995-4c08-9882-44977d04675f None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:27.103996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:27.110189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f0dbd-848d-4b64-80a4-5b0a1eb745ff None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:27.130122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453a9c3-50ab-4715-9ce4-ff1fcc624075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:27.130912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453a9c3-50ab-4715-9ce4-ff1fcc624075 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:27.131314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453a9c3-50ab-4715-9ce4-ff1fcc624075 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:27.131839 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453a9c3-50ab-4715-9ce4-ff1fcc624075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:27.143082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453a9c3-50ab-4715-9ce4-ff1fcc624075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:27.145104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453a9c3-50ab-4715-9ce4-ff1fcc624075 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:27.148726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332cdde-8dd9-4383-ad26-2ff57b1e4405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:27.149517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332cdde-8dd9-4383-ad26-2ff57b1e4405 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:27.149936 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332cdde-8dd9-4383-ad26-2ff57b1e4405 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:27.150344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332cdde-8dd9-4383-ad26-2ff57b1e4405 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:27.157593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332cdde-8dd9-4383-ad26-2ff57b1e4405 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:27.159173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332cdde-8dd9-4383-ad26-2ff57b1e4405 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-e453a9c3-50ab-4715-9ce4-ff1fcc624075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:27.161959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:27.163160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:27.164272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:27.164272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:27.164272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:27.165575 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 282/558] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:27.166473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453a9c3-50ab-4715-9ce4-ff1fcc624075 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-7332cdde-8dd9-4383-ad26-2ff57b1e4405 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:27.174282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:27.175884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:27.176982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:27.176982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:27.176982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:27.176982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:27.176982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:27.176982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:27.176982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:27.176982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:27.178870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 277/559] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:27.179801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332cdde-8dd9-4383-ad26-2ff57b1e4405 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:27.243783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:27.279587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453a9c3-50ab-4715-9ce4-ff1fcc624075 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:27.287434 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332cdde-8dd9-4383-ad26-2ff57b1e4405 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:27.317520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780ba55-ee1a-4983-aedd-0c75a78360c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:27.318279 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780ba55-ee1a-4983-aedd-0c75a78360c1 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:27.318664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780ba55-ee1a-4983-aedd-0c75a78360c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:27.319050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780ba55-ee1a-4983-aedd-0c75a78360c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:27.323142 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eedca2-4bf4-4562-ba52-c24b284831f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:27.323930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eedca2-4bf4-4562-ba52-c24b284831f1 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:27.324351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eedca2-4bf4-4562-ba52-c24b284831f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:27.324762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eedca2-4bf4-4562-ba52-c24b284831f1 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:27.325550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eedca2-4bf4-4562-ba52-c24b284831f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:27.325992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eedca2-4bf4-4562-ba52-c24b284831f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:27.327502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eedca2-4bf4-4562-ba52-c24b284831f1 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:27.341008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 278/560] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:27.342037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eedca2-4bf4-4562-ba52-c24b284831f1 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:27.351863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:27.393192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780ba55-ee1a-4983-aedd-0c75a78360c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:27.394983 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780ba55-ee1a-4983-aedd-0c75a78360c1 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:27.447904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eedca2-4bf4-4562-ba52-c24b284831f1 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:27.466411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:27.486020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2770f1-79ec-4dad-892c-02fb83399a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:27.486966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2770f1-79ec-4dad-892c-02fb83399a6c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:27.487604 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2770f1-79ec-4dad-892c-02fb83399a6c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:27.488021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2770f1-79ec-4dad-892c-02fb83399a6c None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:27.488842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2770f1-79ec-4dad-892c-02fb83399a6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:27.489287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2770f1-79ec-4dad-892c-02fb83399a6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:27.491029 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2770f1-79ec-4dad-892c-02fb83399a6c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:27.504200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 279/561] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:27.504690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 283/562] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:37:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:37:27.505329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2770f1-79ec-4dad-892c-02fb83399a6c None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:27.509443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780ba55-ee1a-4983-aedd-0c75a78360c1 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:27.594619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:27.625789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2770f1-79ec-4dad-892c-02fb83399a6c None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:27.638107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780ba55-ee1a-4983-aedd-0c75a78360c1 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:27.674876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f238999-ee17-4621-b32e-0bdeec9c3b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:27.675828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f238999-ee17-4621-b32e-0bdeec9c3b28 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:27.676384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f238999-ee17-4621-b32e-0bdeec9c3b28 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:27.676868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f238999-ee17-4621-b32e-0bdeec9c3b28 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:27.677790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0099dda-a85b-40ba-adc2-de4cc46bd00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:27.678531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0099dda-a85b-40ba-adc2-de4cc46bd00c None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:27.678890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0099dda-a85b-40ba-adc2-de4cc46bd00c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:27.679373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0099dda-a85b-40ba-adc2-de4cc46bd00c None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/bf5efddd82994140a5f07c926375d477/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:27.681457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0099dda-a85b-40ba-adc2-de4cc46bd00c None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=bf5efddd82994140a5f07c926375d477, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:27.682978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0099dda-a85b-40ba-adc2-de4cc46bd00c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:27.686030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f238999-ee17-4621-b32e-0bdeec9c3b28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:27.687813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f238999-ee17-4621-b32e-0bdeec9c3b28 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:27.697216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 284/563] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:37:27 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/bf5efddd82994140a5f07c926375d477/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:37:27.698169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0099dda-a85b-40ba-adc2-de4cc46bd00c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-4f238999-ee17-4621-b32e-0bdeec9c3b28 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:27.702136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:27.703150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:27.704096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:27.704096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:27.704096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:27.704096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:27.704096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:27.704096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:27.704096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:27.704096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:27.704096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 04:37:27.704096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:27.706930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 280/564] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 04:37:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:27.714880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f238999-ee17-4621-b32e-0bdeec9c3b28 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:27.789359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:27.884813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f238999-ee17-4621-b32e-0bdeec9c3b28 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:27.915183 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0099dda-a85b-40ba-adc2-de4cc46bd00c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:27.928641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe02bc-b277-4f50-a7cf-24f14084bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:27.929261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe02bc-b277-4f50-a7cf-24f14084bdef None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:27.929551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe02bc-b277-4f50-a7cf-24f14084bdef None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:27.929830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe02bc-b277-4f50-a7cf-24f14084bdef None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:27.930578 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe02bc-b277-4f50-a7cf-24f14084bdef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:27.930886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe02bc-b277-4f50-a7cf-24f14084bdef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:27.932678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe02bc-b277-4f50-a7cf-24f14084bdef None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:27.942829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:27.959401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 281/565] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Oct 12 04:37:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:27.959619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9971a1-530a-4dba-817f-4ecf7052eb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:27.960739 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9971a1-530a-4dba-817f-4ecf7052eb27 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:27.960954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe02bc-b277-4f50-a7cf-24f14084bdef None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:27.961217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9971a1-530a-4dba-817f-4ecf7052eb27 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:27.961556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9971a1-530a-4dba-817f-4ecf7052eb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:27.977757 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9971a1-530a-4dba-817f-4ecf7052eb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:27.979222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9971a1-530a-4dba-817f-4ecf7052eb27 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-2d9971a1-530a-4dba-817f-4ecf7052eb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:28.000090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:28.001120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:28.001996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:28.001996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:28.001996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:28.001996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 285/566] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:28.007133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9971a1-530a-4dba-817f-4ecf7052eb27 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:28.167048 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:28.181550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe02bc-b277-4f50-a7cf-24f14084bdef None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:28.186512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9971a1-530a-4dba-817f-4ecf7052eb27 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:28.240279 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625b538-eac7-44e0-b126-d310dede7888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:28.240279 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625b538-eac7-44e0-b126-d310dede7888 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.240279 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625b538-eac7-44e0-b126-d310dede7888 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.240279 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625b538-eac7-44e0-b126-d310dede7888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.252603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625b538-eac7-44e0-b126-d310dede7888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:28.255239 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625b538-eac7-44e0-b126-d310dede7888 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:28.270068 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6f739-4b37-4fb5-b18c-562c68d82647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:28.270932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f739-4b37-4fb5-b18c-562c68d82647 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.271379 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f739-4b37-4fb5-b18c-562c68d82647 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.271892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f739-4b37-4fb5-b18c-562c68d82647 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-0625b538-eac7-44e0-b126-d310dede7888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:28.272659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:28.273726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:28.274834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:28.274834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:28.274834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:28.275107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6f739-4b37-4fb5-b18c-562c68d82647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:28.275592 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6f739-4b37-4fb5-b18c-562c68d82647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:28.276519 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 282/567] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:28.277330 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6f739-4b37-4fb5-b18c-562c68d82647 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:28.281778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625b538-eac7-44e0-b126-d310dede7888 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:28.302845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 286/568] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:28.317033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6f739-4b37-4fb5-b18c-562c68d82647 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:28.357928 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:28.407533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625b538-eac7-44e0-b126-d310dede7888 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:28.442095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6f739-4b37-4fb5-b18c-562c68d82647 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:28.451913 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e117acb-8f7b-4bc0-bc05-235a805a3fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:28.452538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117acb-8f7b-4bc0-bc05-235a805a3fea None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.452818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117acb-8f7b-4bc0-bc05-235a805a3fea None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.453099 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117acb-8f7b-4bc0-bc05-235a805a3fea None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.453761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e117acb-8f7b-4bc0-bc05-235a805a3fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:28.454072 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e117acb-8f7b-4bc0-bc05-235a805a3fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:28.456002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e117acb-8f7b-4bc0-bc05-235a805a3fea None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:28.472745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 283/569] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:28.474303 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d398d2-d95c-44cc-957a-7e99e38c2c79 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.474597 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d398d2-d95c-44cc-957a-7e99e38c2c79 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.474877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d398d2-d95c-44cc-957a-7e99e38c2c79 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.481232 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 284/570] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:28.482305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d398d2-d95c-44cc-957a-7e99e38c2c79 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:28.484838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea4152-ae40-4c4f-958a-e6c1d91b6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:28.485719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea4152-ae40-4c4f-958a-e6c1d91b6513 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.486213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea4152-ae40-4c4f-958a-e6c1d91b6513 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.486710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea4152-ae40-4c4f-958a-e6c1d91b6513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.492877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:28.495366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea4152-ae40-4c4f-958a-e6c1d91b6513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:28.497867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea4152-ae40-4c4f-958a-e6c1d91b6513 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-f8ea4152-ae40-4c4f-958a-e6c1d91b6513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:28.511785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:28.512804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:28.513723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:28.513723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:28.513723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:28.513723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:28.513723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:28.513723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:28.513723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:28.513723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:28.521677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 287/571] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:28.523437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a923-1d6c-4891-938a-af7120885e64 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.523935 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a923-1d6c-4891-938a-af7120885e64 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.524485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a923-1d6c-4891-938a-af7120885e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.543793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8621a923-1d6c-4891-938a-af7120885e64 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:28.545359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8621a923-1d6c-4891-938a-af7120885e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:28.603479 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d398d2-d95c-44cc-957a-7e99e38c2c79 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:28.645694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 288/572] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:28.646844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621a923-1d6c-4891-938a-af7120885e64 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:28.655826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaa616-69f3-4c8c-a9ac-ba8f8be5faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:28.656481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaa616-69f3-4c8c-a9ac-ba8f8be5faee None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.656767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaa616-69f3-4c8c-a9ac-ba8f8be5faee None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.657063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaa616-69f3-4c8c-a9ac-ba8f8be5faee None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.674030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaa616-69f3-4c8c-a9ac-ba8f8be5faee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:28.675969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaa616-69f3-4c8c-a9ac-ba8f8be5faee None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:28.679914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-99eaa616-69f3-4c8c-a9ac-ba8f8be5faee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:28.697452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:28.698560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:28.699699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:28.699699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:28.699699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:28.699699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:28.699699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:28.699699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:28.699699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:28.699699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:28.710435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 285/573] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:28.716060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaa616-69f3-4c8c-a9ac-ba8f8be5faee None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:28.793159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621a923-1d6c-4891-938a-af7120885e64 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:28.794755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:28.833782 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb7978-5614-4456-a2d8-50ab44b0f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:28.834396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7978-5614-4456-a2d8-50ab44b0f464 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.834508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaa616-69f3-4c8c-a9ac-ba8f8be5faee None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:28.834675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7978-5614-4456-a2d8-50ab44b0f464 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.834954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7978-5614-4456-a2d8-50ab44b0f464 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.835678 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb7978-5614-4456-a2d8-50ab44b0f464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:28.835989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb7978-5614-4456-a2d8-50ab44b0f464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:28.837419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb7978-5614-4456-a2d8-50ab44b0f464 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:28.854932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 289/574] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:28.856306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd754425-97c9-4c25-b268-48c4abc0acd9 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.856601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd754425-97c9-4c25-b268-48c4abc0acd9 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.856881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd754425-97c9-4c25-b268-48c4abc0acd9 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.858358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 290/575] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:28.859069 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd754425-97c9-4c25-b268-48c4abc0acd9 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:28.879831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36376dbc-151a-4457-b4a3-a0d8f31f0d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:28.880449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36376dbc-151a-4457-b4a3-a0d8f31f0d45 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.880733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36376dbc-151a-4457-b4a3-a0d8f31f0d45 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.881011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36376dbc-151a-4457-b4a3-a0d8f31f0d45 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.881981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36376dbc-151a-4457-b4a3-a0d8f31f0d45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:28.882683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36376dbc-151a-4457-b4a3-a0d8f31f0d45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:28.884136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36376dbc-151a-4457-b4a3-a0d8f31f0d45 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:28.899354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 286/576] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:28.901462 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf47b4-0b46-4f34-821a-e4c1ffac8d3c None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:28.901748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf47b4-0b46-4f34-821a-e4c1ffac8d3c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:28.902024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf47b4-0b46-4f34-821a-e4c1ffac8d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:28.927814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0fbf47b4-0b46-4f34-821a-e4c1ffac8d3c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:28.929007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0fbf47b4-0b46-4f34-821a-e4c1ffac8d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:28.956634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:28.976284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd754425-97c9-4c25-b268-48c4abc0acd9 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:29.003638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 287/577] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:29.004459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf47b4-0b46-4f34-821a-e4c1ffac8d3c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:29.022442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b8056-ee27-422f-890a-b7b91f8495e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:29.023781 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b8056-ee27-422f-890a-b7b91f8495e8 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:29.024289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b8056-ee27-422f-890a-b7b91f8495e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:29.024778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b8056-ee27-422f-890a-b7b91f8495e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:29.025726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b8056-ee27-422f-890a-b7b91f8495e8 None admin] RBAC: Adding query filter params (role.id=3d2307e73cdb4f6291f9735ac9359702, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=7e02bef3699b4569986b36cec686931a) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:29.026784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b8056-ee27-422f-890a-b7b91f8495e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:29.028993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b8056-ee27-422f-890a-b7b91f8495e8 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:29.038515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 291/578] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:37:28 2022] GET /identity/v3/role_assignments?user.id=7e02bef3699b4569986b36cec686931a&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=3d2307e73cdb4f6291f9735ac9359702 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:29.039674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b8056-ee27-422f-890a-b7b91f8495e8 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:29.067711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:29.164883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf47b4-0b46-4f34-821a-e4c1ffac8d3c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:29.234250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95bc08-d12e-422a-abea-bddc003420c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:29.234861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95bc08-d12e-422a-abea-bddc003420c4 None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:29.235143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95bc08-d12e-422a-abea-bddc003420c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:29.236871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95bc08-d12e-422a-abea-bddc003420c4 None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/91d54c81edf4416488d569bd1377bbf5/roles/bb0934f87e1f44729e10e428242ea249` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:29.258477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b8056-ee27-422f-890a-b7b91f8495e8 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:29.259019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95bc08-d12e-422a-abea-bddc003420c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=91d54c81edf4416488d569bd1377bbf5, role_id=bb0934f87e1f44729e10e428242ea249)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:29.260823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95bc08-d12e-422a-abea-bddc003420c4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:29.278374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 288/579] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:37:29 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/91d54c81edf4416488d569bd1377bbf5/roles/bb0934f87e1f44729e10e428242ea249 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:37:29.295159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95bc08-d12e-422a-abea-bddc003420c4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:29.309464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ee9cd-d667-487c-9e30-fbfdc8e60f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:29.310118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ee9cd-d667-487c-9e30-fbfdc8e60f99 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:29.310402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ee9cd-d667-487c-9e30-fbfdc8e60f99 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:29.310679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ee9cd-d667-487c-9e30-fbfdc8e60f99 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:29.311270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ee9cd-d667-487c-9e30-fbfdc8e60f99 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:29.312695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ee9cd-d667-487c-9e30-fbfdc8e60f99 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-dd9ee9cd-d667-487c-9e30-fbfdc8e60f99 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:29.328242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:29.329508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:29.330634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 292/580] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Oct 12 04:37:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:29.340609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ee9cd-d667-487c-9e30-fbfdc8e60f99 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:29.363980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:29.437722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95bc08-d12e-422a-abea-bddc003420c4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:29.448234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:29.481868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8de06a-abe6-4a50-8ad1-e3aa284995ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:29.482532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de06a-abe6-4a50-8ad1-e3aa284995ab None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:29.482912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de06a-abe6-4a50-8ad1-e3aa284995ab None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:29.483261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de06a-abe6-4a50-8ad1-e3aa284995ab None admin] PATH_INFO: `/v3/services/network` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:29.483965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8de06a-abe6-4a50-8ad1-e3aa284995ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:29.485492 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8de06a-abe6-4a50-8ad1-e3aa284995ab None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:29.492743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ee9cd-d667-487c-9e30-fbfdc8e60f99 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-cb8de06a-abe6-4a50-8ad1-e3aa284995ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:29.497541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:29.498553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:29.499516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 289/581] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:29 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:29.506958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8de06a-abe6-4a50-8ad1-e3aa284995ab None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:29.547237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ff00-cf85-4c3e-af6e-a69dfd00dcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:29.548248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ff00-cf85-4c3e-af6e-a69dfd00dcaf None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:29.548607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ff00-cf85-4c3e-af6e-a69dfd00dcaf None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:29.548964 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ff00-cf85-4c3e-af6e-a69dfd00dcaf None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:29.549672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ff00-cf85-4c3e-af6e-a69dfd00dcaf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:29.550256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ff00-cf85-4c3e-af6e-a69dfd00dcaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:29.552624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ff00-cf85-4c3e-af6e-a69dfd00dcaf None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:29.565329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 293/582] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 04:37:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:29.571626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ff00-cf85-4c3e-af6e-a69dfd00dcaf None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:29.637434 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8de06a-abe6-4a50-8ad1-e3aa284995ab None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:29.677139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c7cee-548d-4d38-9ac6-aff5b9d0a304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:29.677772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c7cee-548d-4d38-9ac6-aff5b9d0a304 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:29.678067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c7cee-548d-4d38-9ac6-aff5b9d0a304 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:29.678360 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c7cee-548d-4d38-9ac6-aff5b9d0a304 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:29.679067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c7cee-548d-4d38-9ac6-aff5b9d0a304 None admin] RBAC: Adding query filter params (name=network) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:29.679427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c7cee-548d-4d38-9ac6-aff5b9d0a304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:29.680829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c7cee-548d-4d38-9ac6-aff5b9d0a304 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:29.686349 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 290/583] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:29.694107 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c7cee-548d-4d38-9ac6-aff5b9d0a304 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:29.761284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:29.767615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:29.808789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ff00-cf85-4c3e-af6e-a69dfd00dcaf None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:29.857255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ec987-2c66-4635-8471-4b31a42cfaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:29.857875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ec987-2c66-4635-8471-4b31a42cfaf5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:29.858157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ec987-2c66-4635-8471-4b31a42cfaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:29.858431 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ec987-2c66-4635-8471-4b31a42cfaf5 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:29.859061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ec987-2c66-4635-8471-4b31a42cfaf5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:29.859404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ec987-2c66-4635-8471-4b31a42cfaf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:29.860784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ec987-2c66-4635-8471-4b31a42cfaf5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:29.871901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 294/584] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 04:37:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:29.878089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ec987-2c66-4635-8471-4b31a42cfaf5 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:29.906225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c7cee-548d-4d38-9ac6-aff5b9d0a304 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:29.992144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ec987-2c66-4635-8471-4b31a42cfaf5 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:29.995487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3476f-9f81-4fdd-bd00-7498713853cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:29.996102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3476f-9f81-4fdd-bd00-7498713853cb None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:29.996391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3476f-9f81-4fdd-bd00-7498713853cb None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:29.996674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3476f-9f81-4fdd-bd00-7498713853cb None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:29.997313 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3476f-9f81-4fdd-bd00-7498713853cb None admin] RBAC: Adding query filter params (type=network) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:29.997621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3476f-9f81-4fdd-bd00-7498713853cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:29.999050 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3476f-9f81-4fdd-bd00-7498713853cb None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:30.013214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 291/585] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:30.024237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3476f-9f81-4fdd-bd00-7498713853cb None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:30.035862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefed361-80e8-43b0-94a3-e2a16e59e9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:30.037984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefed361-80e8-43b0-94a3-e2a16e59e9a4 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:30.038492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefed361-80e8-43b0-94a3-e2a16e59e9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:30.038930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefed361-80e8-43b0-94a3-e2a16e59e9a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:30.039848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefed361-80e8-43b0-94a3-e2a16e59e9a4 None admin] RBAC: Adding query filter params (interface=public, service_id=8ae1330a693643b29b65d94404114ec4, region_id=RegionOne) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:30.040327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefed361-80e8-43b0-94a3-e2a16e59e9a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:30.041920 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefed361-80e8-43b0-94a3-e2a16e59e9a4 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:30.052964 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 295/586] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 04:37:29 2022] GET /identity/v3/endpoints?service_id=8ae1330a693643b29b65d94404114ec4&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:30.059388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefed361-80e8-43b0-94a3-e2a16e59e9a4 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:30.063799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:30.199054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:30.202772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3476f-9f81-4fdd-bd00-7498713853cb None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:30.203027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefed361-80e8-43b0-94a3-e2a16e59e9a4 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:30.242126 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63840ab-7a25-4242-b8f8-9cba14a6d5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:30.243032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f10ea-98dd-4970-a648-d2a74fb28539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:30.243168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63840ab-7a25-4242-b8f8-9cba14a6d5ae None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:30.243607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63840ab-7a25-4242-b8f8-9cba14a6d5ae None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:30.243719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f10ea-98dd-4970-a648-d2a74fb28539 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:30.243960 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f10ea-98dd-4970-a648-d2a74fb28539 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:30.244235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f10ea-98dd-4970-a648-d2a74fb28539 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:30.244444 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63840ab-7a25-4242-b8f8-9cba14a6d5ae None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:30.244934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f10ea-98dd-4970-a648-d2a74fb28539 None admin] RBAC: Adding query filter params (interface=public, service_id=13fe01587f3b43c5975a473c9817b10c, region_id=RegionOne) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:30.245249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f10ea-98dd-4970-a648-d2a74fb28539 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:30.245561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63840ab-7a25-4242-b8f8-9cba14a6d5ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:30.246614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f10ea-98dd-4970-a648-d2a74fb28539 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:30.247345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63840ab-7a25-4242-b8f8-9cba14a6d5ae None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:30.254591 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 296/587] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 04:37:30 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:30.256429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf8d4c-6b79-49e2-bcbe-4ff9902a2843 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:30.256878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf8d4c-6b79-49e2-bcbe-4ff9902a2843 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:30.257392 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf8d4c-6b79-49e2-bcbe-4ff9902a2843 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:30.257552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 292/588] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 04:37:30 2022] GET /identity/v3/endpoints?service_id=13fe01587f3b43c5975a473c9817b10c&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:30.263723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 297/589] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:30.265787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d1ba2-8af1-4471-b5fe-94871faa493e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:30.266083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d1ba2-8af1-4471-b5fe-94871faa493e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:30.266359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d1ba2-8af1-4471-b5fe-94871faa493e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:30.272613 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf8d4c-6b79-49e2-bcbe-4ff9902a2843 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:30.286834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-407d1ba2-8af1-4471-b5fe-94871faa493e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:30.288120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-407d1ba2-8af1-4471-b5fe-94871faa493e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:30.410438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:30.439350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 293/590] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:30.461975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf8d4c-6b79-49e2-bcbe-4ff9902a2843 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:30.500702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f899b-703e-4d2a-81c7-9975448b400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:30.501318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f899b-703e-4d2a-81c7-9975448b400f None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:30.501600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f899b-703e-4d2a-81c7-9975448b400f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:30.501878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f899b-703e-4d2a-81c7-9975448b400f None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:30.502477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f899b-703e-4d2a-81c7-9975448b400f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:30.504466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f899b-703e-4d2a-81c7-9975448b400f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:30.510038 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 298/591] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 04:37:30 2022] GET /identity/v3/services => generated 772 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:30.803825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d1ba2-8af1-4471-b5fe-94871faa493e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:30.901332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:30.911891 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d1ba2-8af1-4471-b5fe-94871faa493e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:30.949503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0867176-dff2-432d-a067-4f7dfcc0796f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:30.950146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0867176-dff2-432d-a067-4f7dfcc0796f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:30.950430 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0867176-dff2-432d-a067-4f7dfcc0796f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:30.950707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0867176-dff2-432d-a067-4f7dfcc0796f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:30.961308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0867176-dff2-432d-a067-4f7dfcc0796f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-d0867176-dff2-432d-a067-4f7dfcc0796f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:30.966483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:30.967454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:30.968306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 294/592] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:37:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:30.976388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f899b-703e-4d2a-81c7-9975448b400f None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:31.087649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f899b-703e-4d2a-81c7-9975448b400f None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:31.131811 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:31.137239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ce858-9eb1-4d85-97a9-4ffe318ce340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:31.137893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ce858-9eb1-4d85-97a9-4ffe318ce340 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:31.138229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ce858-9eb1-4d85-97a9-4ffe318ce340 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:31.138568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ce858-9eb1-4d85-97a9-4ffe318ce340 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:31.139253 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ce858-9eb1-4d85-97a9-4ffe318ce340 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:31.143742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ce858-9eb1-4d85-97a9-4ffe318ce340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:31.145127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ce858-9eb1-4d85-97a9-4ffe318ce340 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:31.154303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 299/593] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:31.160405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0867176-dff2-432d-a067-4f7dfcc0796f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:31.287675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0867176-dff2-432d-a067-4f7dfcc0796f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:31.324319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11091e-7268-4a3c-8301-9271a24fb2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:31.324961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11091e-7268-4a3c-8301-9271a24fb2b8 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:31.325246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11091e-7268-4a3c-8301-9271a24fb2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:31.325519 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11091e-7268-4a3c-8301-9271a24fb2b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:31.337319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11091e-7268-4a3c-8301-9271a24fb2b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:31.338784 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11091e-7268-4a3c-8301-9271a24fb2b8 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-cd11091e-7268-4a3c-8301-9271a24fb2b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:31.354646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:31.355692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:31.356591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:31.356591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:31.356591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:31.356591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 295/594] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:31.361868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ce858-9eb1-4d85-97a9-4ffe318ce340 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:31.523818 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ce858-9eb1-4d85-97a9-4ffe318ce340 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:31.584839 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce981d-ed6f-4f71-bc76-4b11e4387a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:31.585474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce981d-ed6f-4f71-bc76-4b11e4387a44 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:31.585762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce981d-ed6f-4f71-bc76-4b11e4387a44 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:31.586040 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce981d-ed6f-4f71-bc76-4b11e4387a44 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:31.586686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce981d-ed6f-4f71-bc76-4b11e4387a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:31.586992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce981d-ed6f-4f71-bc76-4b11e4387a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:31.588503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce981d-ed6f-4f71-bc76-4b11e4387a44 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:31.607307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 300/595] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:31.616487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11091e-7268-4a3c-8301-9271a24fb2b8 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:31.622914 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:31.759063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11091e-7268-4a3c-8301-9271a24fb2b8 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:31.795880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1e7b5-4d26-45de-af10-c353df4b3c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:31.796442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e7b5-4d26-45de-af10-c353df4b3c80 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:31.796726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e7b5-4d26-45de-af10-c353df4b3c80 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:31.797051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e7b5-4d26-45de-af10-c353df4b3c80 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:31.805426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1e7b5-4d26-45de-af10-c353df4b3c80 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:31.806885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1e7b5-4d26-45de-af10-c353df4b3c80 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-5ea1e7b5-4d26-45de-af10-c353df4b3c80 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:31.825779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:31.826817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:31.827882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:31.827882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:31.827882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:31.827882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:31.827882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:31.827882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:31.827882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:31.827882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:31.827882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 04:37:31.827882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:31.831302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479a07c-6593-4945-865d-bb8d9186ef91 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:31.831302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479a07c-6593-4945-865d-bb8d9186ef91 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:31.831302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479a07c-6593-4945-865d-bb8d9186ef91 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:31.831870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 301/596] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:31.835870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 296/597] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:37:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:31.837287 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ed2ef-3f14-4532-a6d3-67885db0e71d None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:31.837832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ed2ef-3f14-4532-a6d3-67885db0e71d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:31.838311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ed2ef-3f14-4532-a6d3-67885db0e71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:31.838498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1e7b5-4d26-45de-af10-c353df4b3c80 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:31.896488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-753ed2ef-3f14-4532-a6d3-67885db0e71d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:31.898064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-753ed2ef-3f14-4532-a6d3-67885db0e71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:31.910125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:31.968002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1e7b5-4d26-45de-af10-c353df4b3c80 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:32.001705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:32.061681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 302/598] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:32.093339 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e7956-9fcd-4b0f-9bb1-3eeb057a209d None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:32.093624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e7956-9fcd-4b0f-9bb1-3eeb057a209d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:32.094079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e7956-9fcd-4b0f-9bb1-3eeb057a209d None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:32.095906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 303/599] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:32.096021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c586f-d305-4847-8b0c-e1e31097b4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:32.099301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c586f-d305-4847-8b0c-e1e31097b4ab None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:32.099301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c586f-d305-4847-8b0c-e1e31097b4ab None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:32.099301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c586f-d305-4847-8b0c-e1e31097b4ab None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:32.099301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c586f-d305-4847-8b0c-e1e31097b4ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:32.099301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c586f-d305-4847-8b0c-e1e31097b4ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:32.100030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c586f-d305-4847-8b0c-e1e31097b4ab None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:32.100909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180a616-5814-4491-8569-f29ea5b20825 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:32.101195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180a616-5814-4491-8569-f29ea5b20825 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:32.101470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180a616-5814-4491-8569-f29ea5b20825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:32.136326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-7180a616-5814-4491-8569-f29ea5b20825 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:32.137524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-7180a616-5814-4491-8569-f29ea5b20825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:32.142082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 297/600] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Oct 12 04:37:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:32.150585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c586f-d305-4847-8b0c-e1e31097b4ab None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:32.283656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 304/601] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:32.301094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c586f-d305-4847-8b0c-e1e31097b4ab None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:32.327698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:32.343636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6d71f-5e01-476e-b0bf-8b48b3351d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:32.344250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6d71f-5e01-476e-b0bf-8b48b3351d78 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:32.344535 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6d71f-5e01-476e-b0bf-8b48b3351d78 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:32.344812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6d71f-5e01-476e-b0bf-8b48b3351d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:32.403629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180a616-5814-4491-8569-f29ea5b20825 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:32.451088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6d71f-5e01-476e-b0bf-8b48b3351d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:32.453319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6d71f-5e01-476e-b0bf-8b48b3351d78 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:32.607219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180a616-5814-4491-8569-f29ea5b20825 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:32.626004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:32.632398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 298/602] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:37:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:37:32.633502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6d71f-5e01-476e-b0bf-8b48b3351d78 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:32.660304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f6d7a-0d1e-4fa4-bda3-da976cb29574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:32.660942 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f6d7a-0d1e-4fa4-bda3-da976cb29574 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:32.661224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f6d7a-0d1e-4fa4-bda3-da976cb29574 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:32.661500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f6d7a-0d1e-4fa4-bda3-da976cb29574 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:32.662082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f6d7a-0d1e-4fa4-bda3-da976cb29574 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:32.663489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f6d7a-0d1e-4fa4-bda3-da976cb29574 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:32.670403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-d07f6d7a-0d1e-4fa4-bda3-da976cb29574 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:32.672904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:32.673848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:32.674785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 305/603] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Oct 12 04:37:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:32.676129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f6d7a-0d1e-4fa4-bda3-da976cb29574 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:32.751189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6d71f-5e01-476e-b0bf-8b48b3351d78 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:32.787248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f6d7a-0d1e-4fa4-bda3-da976cb29574 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:32.794191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4d516-b29d-488a-9f29-77c6d33c64b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:32.795116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4d516-b29d-488a-9f29-77c6d33c64b4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:32.795629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4d516-b29d-488a-9f29-77c6d33c64b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:32.796118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4d516-b29d-488a-9f29-77c6d33c64b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:32.807130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4d516-b29d-488a-9f29-77c6d33c64b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-05b4d516-b29d-488a-9f29-77c6d33c64b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:32.812593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:32.813499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:37:32.814329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:32.816924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 299/604] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:37:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:32.817898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4d516-b29d-488a-9f29-77c6d33c64b4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:32.831738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d5aa5-e403-41bd-a6f5-ffd6523b07bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:32.832632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d5aa5-e403-41bd-a6f5-ffd6523b07bd None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:32.832919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d5aa5-e403-41bd-a6f5-ffd6523b07bd None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:32.833198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d5aa5-e403-41bd-a6f5-ffd6523b07bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:32.847328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d5aa5-e403-41bd-a6f5-ffd6523b07bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:32.849096 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d5aa5-e403-41bd-a6f5-ffd6523b07bd None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-aa1d5aa5-e403-41bd-a6f5-ffd6523b07bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:32.868225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:32.869217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:32.870109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:32.870109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:32.870109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:32.870109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 306/605] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:32.870956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d5aa5-e403-41bd-a6f5-ffd6523b07bd None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:32.909809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:32.910077 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:32.938357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4d516-b29d-488a-9f29-77c6d33c64b4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:32.975317 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e560f1-1fa5-4d2e-9b9f-8dcae67efa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:32.976171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e560f1-1fa5-4d2e-9b9f-8dcae67efa73 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:32.976592 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e560f1-1fa5-4d2e-9b9f-8dcae67efa73 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:32.977002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e560f1-1fa5-4d2e-9b9f-8dcae67efa73 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:32.977793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e560f1-1fa5-4d2e-9b9f-8dcae67efa73 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:32.978234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e560f1-1fa5-4d2e-9b9f-8dcae67efa73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:32.979765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e560f1-1fa5-4d2e-9b9f-8dcae67efa73 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:32.984823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 300/606] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:32.985885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e560f1-1fa5-4d2e-9b9f-8dcae67efa73 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:33.004681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d5aa5-e403-41bd-a6f5-ffd6523b07bd None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:33.061952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0036bd2-5308-4165-849f-1d480dea4366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:33.062955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0036bd2-5308-4165-849f-1d480dea4366 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.063375 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0036bd2-5308-4165-849f-1d480dea4366 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.064399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0036bd2-5308-4165-849f-1d480dea4366 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.065228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0036bd2-5308-4165-849f-1d480dea4366 None admin] RBAC: Adding query filter params (name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:33.065985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0036bd2-5308-4165-849f-1d480dea4366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:33.067756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0036bd2-5308-4165-849f-1d480dea4366 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:33.084312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 307/607] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:37:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:33.085813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0036bd2-5308-4165-849f-1d480dea4366 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:33.104318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e560f1-1fa5-4d2e-9b9f-8dcae67efa73 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:33.150667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4a10-a477-445e-9ffd-cc5414f621e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:33.151311 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4a10-a477-445e-9ffd-cc5414f621e8 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.151605 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4a10-a477-445e-9ffd-cc5414f621e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.151885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d4a10-a477-445e-9ffd-cc5414f621e8 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.152525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d4a10-a477-445e-9ffd-cc5414f621e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:33.152838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d4a10-a477-445e-9ffd-cc5414f621e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:33.154228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d4a10-a477-445e-9ffd-cc5414f621e8 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:33.166379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 301/608] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:33.167175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4a10-a477-445e-9ffd-cc5414f621e8 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:33.177870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:33.195583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:33.205915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0036bd2-5308-4165-849f-1d480dea4366 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:33.241466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ed279-06d2-4323-bced-449f9f5329d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:33.242077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ed279-06d2-4323-bced-449f9f5329d6 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.242369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ed279-06d2-4323-bced-449f9f5329d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.242673 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ed279-06d2-4323-bced-449f9f5329d6 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.243267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ed279-06d2-4323-bced-449f9f5329d6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:33.243600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ed279-06d2-4323-bced-449f9f5329d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:33.244967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ed279-06d2-4323-bced-449f9f5329d6 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:33.249573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 308/609] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:33.250715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170096a-4455-4415-9687-349cda72bc04 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.250998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170096a-4455-4415-9687-349cda72bc04 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.251272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170096a-4455-4415-9687-349cda72bc04 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.252676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 309/610] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:33.253761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170096a-4455-4415-9687-349cda72bc04 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:33.291456 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d4a10-a477-445e-9ffd-cc5414f621e8 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:33.338118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a71dd-edd7-4884-a751-8f0dca9329c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:33.339073 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a71dd-edd7-4884-a751-8f0dca9329c0 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.339807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a71dd-edd7-4884-a751-8f0dca9329c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.340274 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a71dd-edd7-4884-a751-8f0dca9329c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.355036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a71dd-edd7-4884-a751-8f0dca9329c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:33.357680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a71dd-edd7-4884-a751-8f0dca9329c0 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-223a71dd-edd7-4884-a751-8f0dca9329c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:33.379783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:33.380793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:33.381668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:33.381668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:33.381668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:33.381844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170096a-4455-4415-9687-349cda72bc04 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:33.383663 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 302/611] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:33.385150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9ceba-9e30-4a97-8277-1b862c1bb64a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.385639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9ceba-9e30-4a97-8277-1b862c1bb64a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.386111 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9ceba-9e30-4a97-8277-1b862c1bb64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.406570 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ded9ceba-9e30-4a97-8277-1b862c1bb64a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:33.408408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ded9ceba-9e30-4a97-8277-1b862c1bb64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:33.421268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14f5c0-4b57-4736-85ae-5e0d9051405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:33.421923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14f5c0-4b57-4736-85ae-5e0d9051405d None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.422210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14f5c0-4b57-4736-85ae-5e0d9051405d None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.422492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14f5c0-4b57-4736-85ae-5e0d9051405d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.430567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14f5c0-4b57-4736-85ae-5e0d9051405d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:33.432088 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14f5c0-4b57-4736-85ae-5e0d9051405d None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-2e14f5c0-4b57-4736-85ae-5e0d9051405d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:33.444619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:33.445589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:33.446746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:33.446746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:33.446746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:33.446746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:33.446746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:33.446746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:33.446746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:33.446746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:33.446746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 310/612] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:33.446746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14f5c0-4b57-4736-85ae-5e0d9051405d None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:33.467773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:33.478910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:33.495064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 303/613] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:33.500598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f2d5-2c32-47ff-955d-d7e45cfbecf8 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.500895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f2d5-2c32-47ff-955d-d7e45cfbecf8 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.501177 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f2d5-2c32-47ff-955d-d7e45cfbecf8 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.502581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 304/614] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:33.503192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341f2d5-2c32-47ff-955d-d7e45cfbecf8 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:33.569789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14f5c0-4b57-4736-85ae-5e0d9051405d None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:33.611327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f478777-6637-4f1d-ac38-587fba02f556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:33.612689 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f478777-6637-4f1d-ac38-587fba02f556 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.613242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f478777-6637-4f1d-ac38-587fba02f556 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.613722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f478777-6637-4f1d-ac38-587fba02f556 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.614630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f478777-6637-4f1d-ac38-587fba02f556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:33.615139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f478777-6637-4f1d-ac38-587fba02f556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:33.616797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f478777-6637-4f1d-ac38-587fba02f556 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:33.634251 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 311/615] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:33.635889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e1fb-6be5-4f46-90fa-c037be7b0304 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.636383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e1fb-6be5-4f46-90fa-c037be7b0304 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.636914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e1fb-6be5-4f46-90fa-c037be7b0304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.651946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341f2d5-2c32-47ff-955d-d7e45cfbecf8 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:33.657122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8523e1fb-6be5-4f46-90fa-c037be7b0304 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:33.658616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8523e1fb-6be5-4f46-90fa-c037be7b0304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:33.697305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88eb45-9b11-4181-b54e-c83cae644143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:33.697914 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88eb45-9b11-4181-b54e-c83cae644143 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.698195 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88eb45-9b11-4181-b54e-c83cae644143 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.698471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88eb45-9b11-4181-b54e-c83cae644143 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.700040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88eb45-9b11-4181-b54e-c83cae644143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:33.700352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88eb45-9b11-4181-b54e-c83cae644143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:33.701778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88eb45-9b11-4181-b54e-c83cae644143 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:33.721435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 305/616] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:33.721435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88eb45-9b11-4181-b54e-c83cae644143 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:33.740870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 312/617] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:33.742013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523e1fb-6be5-4f46-90fa-c037be7b0304 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:33.750935 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:33.777556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:33.847210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88eb45-9b11-4181-b54e-c83cae644143 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:33.852277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523e1fb-6be5-4f46-90fa-c037be7b0304 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:33.888847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f834a1-796d-45e0-b4fd-3fd7ce3832fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:33.889789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f834a1-796d-45e0-b4fd-3fd7ce3832fd None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.890276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f834a1-796d-45e0-b4fd-3fd7ce3832fd None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.890773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f834a1-796d-45e0-b4fd-3fd7ce3832fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.891732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f834a1-796d-45e0-b4fd-3fd7ce3832fd None admin] RBAC: Adding query filter params (role.id=3d2307e73cdb4f6291f9735ac9359702, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=bf5efddd82994140a5f07c926375d477) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:33.892270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f834a1-796d-45e0-b4fd-3fd7ce3832fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:33.893156 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef0019-0e29-4667-bd88-0a7d6a4844a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:33.893867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef0019-0e29-4667-bd88-0a7d6a4844a9 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:33.894151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef0019-0e29-4667-bd88-0a7d6a4844a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:33.894420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef0019-0e29-4667-bd88-0a7d6a4844a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:33.894858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f834a1-796d-45e0-b4fd-3fd7ce3832fd None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:33.901147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 313/618] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:37:33 2022] GET /identity/v3/role_assignments?user.id=bf5efddd82994140a5f07c926375d477&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=3d2307e73cdb4f6291f9735ac9359702 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:33.902232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f834a1-796d-45e0-b4fd-3fd7ce3832fd None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:33.903589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef0019-0e29-4667-bd88-0a7d6a4844a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:33.905086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef0019-0e29-4667-bd88-0a7d6a4844a9 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-e3ef0019-0e29-4667-bd88-0a7d6a4844a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:33.927875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:33.928896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:33.929838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 306/619] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 04:37:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:33.935375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef0019-0e29-4667-bd88-0a7d6a4844a9 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:33.987627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:34.038484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f834a1-796d-45e0-b4fd-3fd7ce3832fd None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.070897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef0019-0e29-4667-bd88-0a7d6a4844a9 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.075264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d32725-6546-424a-bf0b-970b608f9b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:34.075935 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d32725-6546-424a-bf0b-970b608f9b31 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:34.076223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d32725-6546-424a-bf0b-970b608f9b31 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:34.076501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d32725-6546-424a-bf0b-970b608f9b31 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:34.077094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d32725-6546-424a-bf0b-970b608f9b31 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:34.078484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d32725-6546-424a-bf0b-970b608f9b31 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:34.084206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-23d32725-6546-424a-bf0b-970b608f9b31 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:34.088340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:34.089420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:34.090513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 314/620] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Oct 12 04:37:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:34.094690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d32725-6546-424a-bf0b-970b608f9b31 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:34.125587 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4591f5-da4c-4eef-a4f7-302a6ce4245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:34.126222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4591f5-da4c-4eef-a4f7-302a6ce4245f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:34.126499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4591f5-da4c-4eef-a4f7-302a6ce4245f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:34.126768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4591f5-da4c-4eef-a4f7-302a6ce4245f None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:34.127527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4591f5-da4c-4eef-a4f7-302a6ce4245f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:34.128372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4591f5-da4c-4eef-a4f7-302a6ce4245f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:34.129958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4591f5-da4c-4eef-a4f7-302a6ce4245f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:34.150343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 307/621] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Oct 12 04:37:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:34.151237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4591f5-da4c-4eef-a4f7-302a6ce4245f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:34.231558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d32725-6546-424a-bf0b-970b608f9b31 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.273081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f33d06-4525-4fbe-9f55-38dbab2ef16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:34.273716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f33d06-4525-4fbe-9f55-38dbab2ef16f None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:34.273991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f33d06-4525-4fbe-9f55-38dbab2ef16f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:34.274264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f33d06-4525-4fbe-9f55-38dbab2ef16f None admin] PATH_INFO: `/v3/services/network` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:34.274836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f33d06-4525-4fbe-9f55-38dbab2ef16f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:34.276224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f33d06-4525-4fbe-9f55-38dbab2ef16f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:34.277522 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4591f5-da4c-4eef-a4f7-302a6ce4245f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.278139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-e6f33d06-4525-4fbe-9f55-38dbab2ef16f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:34.287273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:34.288343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:34.289216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 315/622] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:34 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:34.290029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f33d06-4525-4fbe-9f55-38dbab2ef16f None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:34.325785 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5cab3-b950-433e-832c-c66cf90ee1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:34.326394 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5cab3-b950-433e-832c-c66cf90ee1ad None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:34.326780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5cab3-b950-433e-832c-c66cf90ee1ad None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:34.327059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5cab3-b950-433e-832c-c66cf90ee1ad None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:34.327813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5cab3-b950-433e-832c-c66cf90ee1ad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:34.328177 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5cab3-b950-433e-832c-c66cf90ee1ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:34.329595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5cab3-b950-433e-832c-c66cf90ee1ad None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:34.336623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 308/623] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 04:37:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:34.337612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5cab3-b950-433e-832c-c66cf90ee1ad None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:34.379913 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:34.398371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f33d06-4525-4fbe-9f55-38dbab2ef16f None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.433250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6774e2-1559-4b12-9f72-32fe12997bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:34.433777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6774e2-1559-4b12-9f72-32fe12997bba None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:34.434055 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6774e2-1559-4b12-9f72-32fe12997bba None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:34.434328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6774e2-1559-4b12-9f72-32fe12997bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:34.464459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5cab3-b950-433e-832c-c66cf90ee1ad None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.501884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f53f3-7f94-40d1-b28e-8275dac72ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:34.502635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f53f3-7f94-40d1-b28e-8275dac72ac4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:34.502971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f53f3-7f94-40d1-b28e-8275dac72ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:34.503248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f53f3-7f94-40d1-b28e-8275dac72ac4 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:34.503894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f53f3-7f94-40d1-b28e-8275dac72ac4 None admin] RBAC: Adding query filter params (name=network) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:34.504195 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f53f3-7f94-40d1-b28e-8275dac72ac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:34.505556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f53f3-7f94-40d1-b28e-8275dac72ac4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:34.510466 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 309/624] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:34.511269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f53f3-7f94-40d1-b28e-8275dac72ac4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:34.517417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:34.523119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6774e2-1559-4b12-9f72-32fe12997bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:34.525481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6774e2-1559-4b12-9f72-32fe12997bba None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:34.636564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f53f3-7f94-40d1-b28e-8275dac72ac4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.639628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:34.655561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 316/625] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:37:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:37:34.656633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6774e2-1559-4b12-9f72-32fe12997bba None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:34.680222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee0a1b-06ce-4df2-a567-456b7276c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:34.680840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee0a1b-06ce-4df2-a567-456b7276c33f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:34.681125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee0a1b-06ce-4df2-a567-456b7276c33f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:34.681401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee0a1b-06ce-4df2-a567-456b7276c33f None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:34.682032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee0a1b-06ce-4df2-a567-456b7276c33f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:34.682442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee0a1b-06ce-4df2-a567-456b7276c33f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:34.683899 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee0a1b-06ce-4df2-a567-456b7276c33f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:34.694624 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 310/626] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Oct 12 04:37:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:34.695691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee0a1b-06ce-4df2-a567-456b7276c33f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:34.760986 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:34.764718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6774e2-1559-4b12-9f72-32fe12997bba None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.801653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf950-f424-4e6e-8dfb-41fd96fdbb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:34.802590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf950-f424-4e6e-8dfb-41fd96fdbb8d None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:34.802878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf950-f424-4e6e-8dfb-41fd96fdbb8d None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:34.803152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf950-f424-4e6e-8dfb-41fd96fdbb8d None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:34.804074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cf950-f424-4e6e-8dfb-41fd96fdbb8d None admin] RBAC: Adding query filter params (type=network) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:34.804387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cf950-f424-4e6e-8dfb-41fd96fdbb8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:34.806411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cf950-f424-4e6e-8dfb-41fd96fdbb8d None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:34.808245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee0a1b-06ce-4df2-a567-456b7276c33f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.812353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 317/627] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:34.818452 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf950-f424-4e6e-8dfb-41fd96fdbb8d None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:34.848664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1ab66-f45b-42d6-aec8-b9f42bdbae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:34.849361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ab66-f45b-42d6-aec8-b9f42bdbae8a None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:34.849573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ab66-f45b-42d6-aec8-b9f42bdbae8a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:34.849852 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ab66-f45b-42d6-aec8-b9f42bdbae8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:34.860299 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1ab66-f45b-42d6-aec8-b9f42bdbae8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:34.861776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1ab66-f45b-42d6-aec8-b9f42bdbae8a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-9ee1ab66-f45b-42d6-aec8-b9f42bdbae8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:34.877517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:34.879078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:34.880080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:34.880080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:34.880080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:34.883541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 311/628] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:34.884373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1ab66-f45b-42d6-aec8-b9f42bdbae8a None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:34.897795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:34.954863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf950-f424-4e6e-8dfb-41fd96fdbb8d None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.994292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773b0bc-c9c5-4adb-934d-8a32fca85467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:34.994918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773b0bc-c9c5-4adb-934d-8a32fca85467 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:34.995201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773b0bc-c9c5-4adb-934d-8a32fca85467 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:34.995508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773b0bc-c9c5-4adb-934d-8a32fca85467 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:34.996173 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773b0bc-c9c5-4adb-934d-8a32fca85467 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:34.997320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1ab66-f45b-42d6-aec8-b9f42bdbae8a None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:34.997538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773b0bc-c9c5-4adb-934d-8a32fca85467 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:35.025852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 318/629] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:37:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:35.027216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773b0bc-c9c5-4adb-934d-8a32fca85467 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:35.064841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7a753-8108-4a01-b0a8-30f4a2e3835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:35.065490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:35.065622 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7a753-8108-4a01-b0a8-30f4a2e3835b None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:35.065786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7a753-8108-4a01-b0a8-30f4a2e3835b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:35.066392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7a753-8108-4a01-b0a8-30f4a2e3835b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:35.067071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7a753-8108-4a01-b0a8-30f4a2e3835b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:35.068516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7a753-8108-4a01-b0a8-30f4a2e3835b None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:35.117137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 312/630] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:37:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:35.215359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773b0bc-c9c5-4adb-934d-8a32fca85467 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:35.275520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444c1e2-2b1f-4c0e-80c7-53b9411caf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:35.276548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444c1e2-2b1f-4c0e-80c7-53b9411caf16 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:35.277064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444c1e2-2b1f-4c0e-80c7-53b9411caf16 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:35.277541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444c1e2-2b1f-4c0e-80c7-53b9411caf16 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:35.278412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444c1e2-2b1f-4c0e-80c7-53b9411caf16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:35.278923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444c1e2-2b1f-4c0e-80c7-53b9411caf16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:35.280578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444c1e2-2b1f-4c0e-80c7-53b9411caf16 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:35.295587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 319/631] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:35.302171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7a753-8108-4a01-b0a8-30f4a2e3835b None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:35.383901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:35.427708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7a753-8108-4a01-b0a8-30f4a2e3835b None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:35.462753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd46f1a-786f-4ddf-bcdb-0642db7fe1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:35.463417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd46f1a-786f-4ddf-bcdb-0642db7fe1f7 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:35.463701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd46f1a-786f-4ddf-bcdb-0642db7fe1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:35.463976 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd46f1a-786f-4ddf-bcdb-0642db7fe1f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:35.471306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd46f1a-786f-4ddf-bcdb-0642db7fe1f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:35.473230 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd46f1a-786f-4ddf-bcdb-0642db7fe1f7 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-ccd46f1a-786f-4ddf-bcdb-0642db7fe1f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:35.484632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:35.485527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:35.486414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:35.486414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:35.486414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:35.486414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:35.486414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:35.486414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:35.486414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:35.486414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:35.486414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 313/632] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:35.491672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444c1e2-2b1f-4c0e-80c7-53b9411caf16 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:35.604846 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:35.636133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444c1e2-2b1f-4c0e-80c7-53b9411caf16 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:35.662071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05315aba-3b22-49ef-8a21-b77b5cb74cea None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:35.662562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05315aba-3b22-49ef-8a21-b77b5cb74cea None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:35.662849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05315aba-3b22-49ef-8a21-b77b5cb74cea None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:35.666036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 314/633] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:35.670876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34050a-54b9-404a-ab98-4d279785d257 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:35.671164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34050a-54b9-404a-ab98-4d279785d257 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:35.671480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34050a-54b9-404a-ab98-4d279785d257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:35.674577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1f147-6140-42b5-b373-bd305d36a7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:35.675202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1f147-6140-42b5-b373-bd305d36a7ea None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:35.675520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1f147-6140-42b5-b373-bd305d36a7ea None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:35.675798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1f147-6140-42b5-b373-bd305d36a7ea None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:35.676493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1f147-6140-42b5-b373-bd305d36a7ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:35.676802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1f147-6140-42b5-b373-bd305d36a7ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:35.678425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1f147-6140-42b5-b373-bd305d36a7ea None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:35.691605 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5b34050a-54b9-404a-ab98-4d279785d257 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:35.691904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 320/634] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:35.692960 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5b34050a-54b9-404a-ab98-4d279785d257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:35.697726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1f147-6140-42b5-b373-bd305d36a7ea None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:35.787958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 315/635] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:35.808798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1f147-6140-42b5-b373-bd305d36a7ea None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:35.844284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33dae8-8730-455e-bfac-53433a47595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:35.844895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dae8-8730-455e-bfac-53433a47595e None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:35.845177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dae8-8730-455e-bfac-53433a47595e None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:35.845457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dae8-8730-455e-bfac-53433a47595e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:35.846178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dae8-8730-455e-bfac-53433a47595e None admin] RBAC: Adding query filter params (role.id=bb0934f87e1f44729e10e428242ea249, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=91d54c81edf4416488d569bd1377bbf5) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:35.846538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dae8-8730-455e-bfac-53433a47595e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:35.848531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dae8-8730-455e-bfac-53433a47595e None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:35.850216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:35.855475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 321/636] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:37:35 2022] GET /identity/v3/role_assignments?user.id=91d54c81edf4416488d569bd1377bbf5&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=bb0934f87e1f44729e10e428242ea249 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:36.058452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34050a-54b9-404a-ab98-4d279785d257 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:36.115002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:36.167830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34050a-54b9-404a-ab98-4d279785d257 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:36.203792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e61ae-7aa3-4cb4-bd79-f838b53c9f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:36.204777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e61ae-7aa3-4cb4-bd79-f838b53c9f5e None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:36.205265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e61ae-7aa3-4cb4-bd79-f838b53c9f5e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:36.205784 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e61ae-7aa3-4cb4-bd79-f838b53c9f5e None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:36.206649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e61ae-7aa3-4cb4-bd79-f838b53c9f5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:36.208280 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e61ae-7aa3-4cb4-bd79-f838b53c9f5e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:36.226275 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 316/637] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:37:36 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:36.402320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b4028-cc3e-48ef-a105-41a51bf0eb43 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:36.402678 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b4028-cc3e-48ef-a105-41a51bf0eb43 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:36.402853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b4028-cc3e-48ef-a105-41a51bf0eb43 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:36.404324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 322/638] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:36.410433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7b786-e0a6-4493-a342-54b98f686e44 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:36.410798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7b786-e0a6-4493-a342-54b98f686e44 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:36.411023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7b786-e0a6-4493-a342-54b98f686e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:36.431953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-01e7b786-e0a6-4493-a342-54b98f686e44 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:36.433374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-01e7b786-e0a6-4493-a342-54b98f686e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:36.511234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 317/639] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:36 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:36.780888 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b4028-cc3e-48ef-a105-41a51bf0eb43 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:36.892068 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b4028-cc3e-48ef-a105-41a51bf0eb43 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:36.926680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc89a1a-297a-443e-99f9-3f7149f1d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:36.927334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc89a1a-297a-443e-99f9-3f7149f1d84a None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:36.927623 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc89a1a-297a-443e-99f9-3f7149f1d84a None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:36.927902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc89a1a-297a-443e-99f9-3f7149f1d84a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:36.928479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc89a1a-297a-443e-99f9-3f7149f1d84a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:36.929840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc89a1a-297a-443e-99f9-3f7149f1d84a None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-bdc89a1a-297a-443e-99f9-3f7149f1d84a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:36.938649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:36.939672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:36.940564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 323/640] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:36.946474 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7b786-e0a6-4493-a342-54b98f686e44 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:36.987347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:37.052496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7b786-e0a6-4493-a342-54b98f686e44 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:37.088066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b9a05-f4e5-4981-bda8-21964c342d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:37.089764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9a05-f4e5-4981-bda8-21964c342d53 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:37.090266 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9a05-f4e5-4981-bda8-21964c342d53 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:37.090742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b9a05-f4e5-4981-bda8-21964c342d53 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:37.091613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b9a05-f4e5-4981-bda8-21964c342d53 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:37.092141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b9a05-f4e5-4981-bda8-21964c342d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:37.093713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b9a05-f4e5-4981-bda8-21964c342d53 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:37.099691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 318/641] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:37:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:37.111418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc89a1a-297a-443e-99f9-3f7149f1d84a None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:37.178562 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:37.222403 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc89a1a-297a-443e-99f9-3f7149f1d84a None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:37.257311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eae1b-f233-4f57-afb7-6429cfc4d404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:37.257984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eae1b-f233-4f57-afb7-6429cfc4d404 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:37.258272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eae1b-f233-4f57-afb7-6429cfc4d404 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:37.258553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eae1b-f233-4f57-afb7-6429cfc4d404 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:37.259178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6eae1b-f233-4f57-afb7-6429cfc4d404 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:37.259516 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6eae1b-f233-4f57-afb7-6429cfc4d404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:37.260883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6eae1b-f233-4f57-afb7-6429cfc4d404 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:37.265720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 324/642] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:37:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:37.486777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41122a-76b2-46b7-8f32-b7bda89f7232 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:37.487677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41122a-76b2-46b7-8f32-b7bda89f7232 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:37.487958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41122a-76b2-46b7-8f32-b7bda89f7232 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:37.489544 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 319/643] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:37.494775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0cb35-97f6-4ef8-a278-8ddc5292ebb1 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:37.495062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0cb35-97f6-4ef8-a278-8ddc5292ebb1 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:37.495358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0cb35-97f6-4ef8-a278-8ddc5292ebb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:37.518063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a4f0cb35-97f6-4ef8-a278-8ddc5292ebb1 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:37.519898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a4f0cb35-97f6-4ef8-a278-8ddc5292ebb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:37.597854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 325/644] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:37 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:37.868739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41122a-76b2-46b7-8f32-b7bda89f7232 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:37.970907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41122a-76b2-46b7-8f32-b7bda89f7232 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:37.973083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:38.007694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5165431-70eb-4051-a1ed-b6ae99b7d98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:38.008355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165431-70eb-4051-a1ed-b6ae99b7d98a None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:38.008643 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165431-70eb-4051-a1ed-b6ae99b7d98a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:38.008920 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165431-70eb-4051-a1ed-b6ae99b7d98a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:38.009520 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5165431-70eb-4051-a1ed-b6ae99b7d98a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:38.010935 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5165431-70eb-4051-a1ed-b6ae99b7d98a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-a5165431-70eb-4051-a1ed-b6ae99b7d98a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:38.021064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:38.022123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:38.022962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 320/645] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:37:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:38.028267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0cb35-97f6-4ef8-a278-8ddc5292ebb1 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:38.087100 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:38.138095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0cb35-97f6-4ef8-a278-8ddc5292ebb1 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:38.145436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c9e0-c8fe-44f3-9fac-c5a7b4b17f9d None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:38.145912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c9e0-c8fe-44f3-9fac-c5a7b4b17f9d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:38.146020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2c9e0-c8fe-44f3-9fac-c5a7b4b17f9d None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:38.147475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 321/646] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:38.152267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ea8b2-5c9a-43d8-8074-9ea2ccf2d91d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:38.152810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ea8b2-5c9a-43d8-8074-9ea2ccf2d91d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:38.153270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ea8b2-5c9a-43d8-8074-9ea2ccf2d91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:38.172588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-059ea8b2-5c9a-43d8-8074-9ea2ccf2d91d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:38.174236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-059ea8b2-5c9a-43d8-8074-9ea2ccf2d91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:38.179696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97745e8-eb96-4bbb-b96c-951bb6a4a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:38.180579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97745e8-eb96-4bbb-b96c-951bb6a4a308 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:38.181001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97745e8-eb96-4bbb-b96c-951bb6a4a308 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:38.181443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97745e8-eb96-4bbb-b96c-951bb6a4a308 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:38.182229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97745e8-eb96-4bbb-b96c-951bb6a4a308 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:38.182675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97745e8-eb96-4bbb-b96c-951bb6a4a308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:38.184244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97745e8-eb96-4bbb-b96c-951bb6a4a308 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:38.189976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 326/647] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:37:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:38.197283 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97745e8-eb96-4bbb-b96c-951bb6a4a308 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:38.259531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 322/648] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:38 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:38.318195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97745e8-eb96-4bbb-b96c-951bb6a4a308 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:38.338506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:38.353272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9baae4a-c814-419d-9a28-e63c03f5b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:38.353881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baae4a-c814-419d-9a28-e63c03f5b511 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:38.354159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baae4a-c814-419d-9a28-e63c03f5b511 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:38.354434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baae4a-c814-419d-9a28-e63c03f5b511 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:38.355052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9baae4a-c814-419d-9a28-e63c03f5b511 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:38.355381 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9baae4a-c814-419d-9a28-e63c03f5b511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:38.356738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9baae4a-c814-419d-9a28-e63c03f5b511 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:38.361582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 327/649] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:37:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:38.530411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ea8b2-5c9a-43d8-8074-9ea2ccf2d91d None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:38.538338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f834d-3d11-48f7-a60e-74916e5e839b None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:38.538625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f834d-3d11-48f7-a60e-74916e5e839b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:38.538912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f834d-3d11-48f7-a60e-74916e5e839b None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:38.540553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 328/650] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:38.545597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db89d6-6b4b-4210-a54a-551bcc25d607 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:38.545889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db89d6-6b4b-4210-a54a-551bcc25d607 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:38.546163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db89d6-6b4b-4210-a54a-551bcc25d607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:38.570117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-92db89d6-6b4b-4210-a54a-551bcc25d607 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:38.571344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-92db89d6-6b4b-4210-a54a-551bcc25d607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:38.649136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:38.655413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 329/651] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:38 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:38.655964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ea8b2-5c9a-43d8-8074-9ea2ccf2d91d None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:38.692053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e9cba-f41f-457f-8ee2-62d5151b407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:38.693040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e9cba-f41f-457f-8ee2-62d5151b407b None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:38.693551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e9cba-f41f-457f-8ee2-62d5151b407b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:38.694006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e9cba-f41f-457f-8ee2-62d5151b407b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:38.704885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e9cba-f41f-457f-8ee2-62d5151b407b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-0a1e9cba-f41f-457f-8ee2-62d5151b407b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:38.710088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:38.711044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 04:37:38.711939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:38.714300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 323/652] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 04:37:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:38.720542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db89d6-6b4b-4210-a54a-551bcc25d607 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:38.825923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db89d6-6b4b-4210-a54a-551bcc25d607 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:38.841489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:38.863603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54031786-ad2b-4162-af6c-67efe87a8cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:38.864442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54031786-ad2b-4162-af6c-67efe87a8cd5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:38.864875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54031786-ad2b-4162-af6c-67efe87a8cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:38.865300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54031786-ad2b-4162-af6c-67efe87a8cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:38.866109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54031786-ad2b-4162-af6c-67efe87a8cd5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:38.866588 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54031786-ad2b-4162-af6c-67efe87a8cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:38.868147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54031786-ad2b-4162-af6c-67efe87a8cd5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:38.877187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 330/653] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Oct 12 04:37:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:38.883076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e9cba-f41f-457f-8ee2-62d5151b407b None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:38.938478 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54031786-ad2b-4162-af6c-67efe87a8cd5 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:38.999043 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e9cba-f41f-457f-8ee2-62d5151b407b None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:39.040175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9d418-fb79-4eda-8f9d-0b8bc2f00b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:39.041687 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9d418-fb79-4eda-8f9d-0b8bc2f00b8a None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.042194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9d418-fb79-4eda-8f9d-0b8bc2f00b8a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.042619 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9d418-fb79-4eda-8f9d-0b8bc2f00b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.043489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54031786-ad2b-4162-af6c-67efe87a8cd5 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:39.054912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9d418-fb79-4eda-8f9d-0b8bc2f00b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:39.056611 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9d418-fb79-4eda-8f9d-0b8bc2f00b8a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-11c9d418-fb79-4eda-8f9d-0b8bc2f00b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:39.075350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:39.076641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:39.077869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:39.077869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:39.077869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:39.084653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbad288-d127-4bb3-94dc-281accca488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:39.084653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbad288-d127-4bb3-94dc-281accca488a None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.084653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbad288-d127-4bb3-94dc-281accca488a None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.084653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbad288-d127-4bb3-94dc-281accca488a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.085105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 324/654] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:39.085349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbad288-d127-4bb3-94dc-281accca488a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:39.086249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9d418-fb79-4eda-8f9d-0b8bc2f00b8a None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:39.086968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbad288-d127-4bb3-94dc-281accca488a None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-9bbad288-d127-4bb3-94dc-281accca488a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:39.098683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:39.099723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 04:37:39.100610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:39.103412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 331/655] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Oct 12 04:37:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:39.104931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:39.105907 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbad288-d127-4bb3-94dc-281accca488a None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:39.165230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:39.219870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9d418-fb79-4eda-8f9d-0b8bc2f00b8a None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:39.244320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbad288-d127-4bb3-94dc-281accca488a None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:39.270209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee644352-f56b-4e76-b5d9-4148e7e43d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:39.271480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee644352-f56b-4e76-b5d9-4148e7e43d5a None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.272306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee644352-f56b-4e76-b5d9-4148e7e43d5a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.273328 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee644352-f56b-4e76-b5d9-4148e7e43d5a None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.274543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee644352-f56b-4e76-b5d9-4148e7e43d5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:39.275113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee644352-f56b-4e76-b5d9-4148e7e43d5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:39.277874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee644352-f56b-4e76-b5d9-4148e7e43d5a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:39.281996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c9ef-aee4-4179-b43e-e71814eba225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:39.282485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c9ef-aee4-4179-b43e-e71814eba225 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.282877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c9ef-aee4-4179-b43e-e71814eba225 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.283264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c9ef-aee4-4179-b43e-e71814eba225 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.284557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681c9ef-aee4-4179-b43e-e71814eba225 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:39.284967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681c9ef-aee4-4179-b43e-e71814eba225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:39.286585 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681c9ef-aee4-4179-b43e-e71814eba225 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:39.296593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 332/656] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:39.297612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c9ef-aee4-4179-b43e-e71814eba225 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:39.299637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 325/657] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:39.308224 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee644352-f56b-4e76-b5d9-4148e7e43d5a None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:39.408094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:39.410506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c9ef-aee4-4179-b43e-e71814eba225 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:39.416253 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:39.452441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46d13c-6fec-45f6-8c16-c481191bdb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:39.452662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee644352-f56b-4e76-b5d9-4148e7e43d5a None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:39.453555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46d13c-6fec-45f6-8c16-c481191bdb90 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.454143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46d13c-6fec-45f6-8c16-c481191bdb90 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.454616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46d13c-6fec-45f6-8c16-c481191bdb90 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.455699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46d13c-6fec-45f6-8c16-c481191bdb90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:39.456255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46d13c-6fec-45f6-8c16-c481191bdb90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:39.457844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46d13c-6fec-45f6-8c16-c481191bdb90 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:39.463697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 333/658] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:39.469733 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46d13c-6fec-45f6-8c16-c481191bdb90 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:39.499831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b12afb-7944-4559-b55b-8e0e76002bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:39.500473 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b12afb-7944-4559-b55b-8e0e76002bf6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.500783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b12afb-7944-4559-b55b-8e0e76002bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.501363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b12afb-7944-4559-b55b-8e0e76002bf6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.509641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b12afb-7944-4559-b55b-8e0e76002bf6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:39.511105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b12afb-7944-4559-b55b-8e0e76002bf6 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-06b12afb-7944-4559-b55b-8e0e76002bf6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:39.522932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:39.523933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:39.524878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 326/659] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 04:37:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:39.525993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010b281-73ed-42ce-8e27-87bd6140a369 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.525993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010b281-73ed-42ce-8e27-87bd6140a369 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.526148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010b281-73ed-42ce-8e27-87bd6140a369 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.531332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 327/660] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:39.531332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010b281-73ed-42ce-8e27-87bd6140a369 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:39.584715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46d13c-6fec-45f6-8c16-c481191bdb90 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:39.619394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49458223-dc90-448b-8978-4e33e1a340b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:39.620029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49458223-dc90-448b-8978-4e33e1a340b8 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.620315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49458223-dc90-448b-8978-4e33e1a340b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.620589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49458223-dc90-448b-8978-4e33e1a340b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.621284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49458223-dc90-448b-8978-4e33e1a340b8 None admin] RBAC: Adding query filter params (interface=public, service_id=4fbab524ea1e472693d6d6d91d98f5f0, region_id=RegionOne) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:39.621594 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49458223-dc90-448b-8978-4e33e1a340b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:39.623121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49458223-dc90-448b-8978-4e33e1a340b8 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:39.632647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 334/661] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 04:37:39 2022] GET /identity/v3/endpoints?service_id=4fbab524ea1e472693d6d6d91d98f5f0&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:39.632647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb5a47-238a-477c-919c-8f799a1cf65e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.632647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb5a47-238a-477c-919c-8f799a1cf65e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.632647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb5a47-238a-477c-919c-8f799a1cf65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.649132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-78fb5a47-238a-477c-919c-8f799a1cf65e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:39.650491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-78fb5a47-238a-477c-919c-8f799a1cf65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:39.654304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010b281-73ed-42ce-8e27-87bd6140a369 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:39.677373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:39.682508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:39.692018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a14b3a-614c-4496-9b13-0e3191699f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:39.692632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a14b3a-614c-4496-9b13-0e3191699f1f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.692909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a14b3a-614c-4496-9b13-0e3191699f1f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.693186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a14b3a-614c-4496-9b13-0e3191699f1f None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.693910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a14b3a-614c-4496-9b13-0e3191699f1f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:39.694249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a14b3a-614c-4496-9b13-0e3191699f1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:39.695677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a14b3a-614c-4496-9b13-0e3191699f1f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:39.716451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 328/662] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Oct 12 04:37:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:39.717781 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a14b3a-614c-4496-9b13-0e3191699f1f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:39.723298 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 335/663] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:39 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:39.724368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb5a47-238a-477c-919c-8f799a1cf65e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:39.837290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a14b3a-614c-4496-9b13-0e3191699f1f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:39.843596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb5a47-238a-477c-919c-8f799a1cf65e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:39.878139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc9b2-acd7-4865-83ba-df494e6249a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:39.879136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc9b2-acd7-4865-83ba-df494e6249a9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.879647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc9b2-acd7-4865-83ba-df494e6249a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.880136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc9b2-acd7-4865-83ba-df494e6249a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.881537 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3440b1-ccbc-4961-aa71-e239cebc435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:39.882207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3440b1-ccbc-4961-aa71-e239cebc435f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:39.882497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3440b1-ccbc-4961-aa71-e239cebc435f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:39.882954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3440b1-ccbc-4961-aa71-e239cebc435f None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:39.883595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3440b1-ccbc-4961-aa71-e239cebc435f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:39.885286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3440b1-ccbc-4961-aa71-e239cebc435f None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:39.891937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dc9b2-acd7-4865-83ba-df494e6249a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:39.894228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dc9b2-acd7-4865-83ba-df494e6249a9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:39.895438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 329/664] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 04:37:39 2022] GET /identity/v3/services => generated 1029 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-713dc9b2-acd7-4865-83ba-df494e6249a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:39.915544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:39.916568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:39.917563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:39.917563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:39.917563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:39.919893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 336/665] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:39.928546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3440b1-ccbc-4961-aa71-e239cebc435f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:39.985222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:40.007543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc9b2-acd7-4865-83ba-df494e6249a9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:40.024307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:40.054910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3440b1-ccbc-4961-aa71-e239cebc435f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:40.108243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2482f-9e6b-4789-ab8b-5ff38d4b24f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:40.108569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2482f-9e6b-4789-ab8b-5ff38d4b24f6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:40.109188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2482f-9e6b-4789-ab8b-5ff38d4b24f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:40.109188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2482f-9e6b-4789-ab8b-5ff38d4b24f6 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:40.109755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2482f-9e6b-4789-ab8b-5ff38d4b24f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:40.110063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2482f-9e6b-4789-ab8b-5ff38d4b24f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:40.112224 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2482f-9e6b-4789-ab8b-5ff38d4b24f6 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:40.128671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 330/666] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:40.129803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc9b2-acd7-4865-83ba-df494e6249a9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:40.134182 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2482f-9e6b-4789-ab8b-5ff38d4b24f6 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:40.174149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86b962-92b1-449e-96f6-b3161279094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:40.174820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86b962-92b1-449e-96f6-b3161279094c None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:40.175107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86b962-92b1-449e-96f6-b3161279094c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:40.175417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86b962-92b1-449e-96f6-b3161279094c None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:40.176087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86b962-92b1-449e-96f6-b3161279094c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:40.177469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86b962-92b1-449e-96f6-b3161279094c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:40.203389 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 337/667] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:37:40 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:37:40.264227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2482f-9e6b-4789-ab8b-5ff38d4b24f6 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:40.277029 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:40.310127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64593d7-0ddb-458e-8127-e291ac97a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:40.310774 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64593d7-0ddb-458e-8127-e291ac97a707 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:40.311059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64593d7-0ddb-458e-8127-e291ac97a707 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:40.311362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64593d7-0ddb-458e-8127-e291ac97a707 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:40.319439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64593d7-0ddb-458e-8127-e291ac97a707 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:40.320989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64593d7-0ddb-458e-8127-e291ac97a707 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-a64593d7-0ddb-458e-8127-e291ac97a707 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:40.334389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:40.335389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:40.336702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:40.336702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:40.336702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:40.336702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:40.336702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:40.336702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:40.336702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:40.336702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:40.336702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 331/668] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:40.342041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86b962-92b1-449e-96f6-b3161279094c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:40.431132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:40.465643 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86b962-92b1-449e-96f6-b3161279094c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:40.502995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a7203-1f95-4a61-ae96-5d80e1e31113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:40.503696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a7203-1f95-4a61-ae96-5d80e1e31113 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:40.503988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a7203-1f95-4a61-ae96-5d80e1e31113 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:40.504267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a7203-1f95-4a61-ae96-5d80e1e31113 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:40.504961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a7203-1f95-4a61-ae96-5d80e1e31113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:40.505270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a7203-1f95-4a61-ae96-5d80e1e31113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:40.506716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a7203-1f95-4a61-ae96-5d80e1e31113 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:40.520527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 338/669] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:40.526057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64593d7-0ddb-458e-8127-e291ac97a707 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:40.564376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eb00b-69e6-4f28-b8be-1c55d2a33387 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:40.564697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eb00b-69e6-4f28-b8be-1c55d2a33387 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:40.564926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eb00b-69e6-4f28-b8be-1c55d2a33387 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:40.566647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 339/670] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:40.571583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb68e-a706-4006-8d9e-39d09221493a None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:40.571866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb68e-a706-4006-8d9e-39d09221493a None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:40.572140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb68e-a706-4006-8d9e-39d09221493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:40.591648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-1bbcb68e-a706-4006-8d9e-39d09221493a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:40.592915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1bbcb68e-a706-4006-8d9e-39d09221493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:40.643962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64593d7-0ddb-458e-8127-e291ac97a707 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:40.679432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bd372-0bd9-4cdb-a559-3e5c5a57faca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:40.680093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 340/671] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:40 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:40.680213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bd372-0bd9-4cdb-a559-3e5c5a57faca None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:40.680375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bd372-0bd9-4cdb-a559-3e5c5a57faca None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:40.687582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bd372-0bd9-4cdb-a559-3e5c5a57faca None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/91d54c81edf4416488d569bd1377bbf5/roles/cea949ae420a46e18943f9f02af359b7` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:40.691688 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9bd372-0bd9-4cdb-a559-3e5c5a57faca None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=91d54c81edf4416488d569bd1377bbf5, role_id=cea949ae420a46e18943f9f02af359b7)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:40.693397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9bd372-0bd9-4cdb-a559-3e5c5a57faca None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:40.711249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 332/672] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:37:40 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/91d54c81edf4416488d569bd1377bbf5/roles/cea949ae420a46e18943f9f02af359b7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:37:40.963377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcb68e-a706-4006-8d9e-39d09221493a None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:41.029581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:41.070525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcb68e-a706-4006-8d9e-39d09221493a None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:41.106724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74e29d-5166-40c0-80a4-5113730cf4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:41.107428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74e29d-5166-40c0-80a4-5113730cf4d8 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:41.107719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74e29d-5166-40c0-80a4-5113730cf4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:41.108003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74e29d-5166-40c0-80a4-5113730cf4d8 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:41.108663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74e29d-5166-40c0-80a4-5113730cf4d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:41.110045 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74e29d-5166-40c0-80a4-5113730cf4d8 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:41.127649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 341/673] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:37:40 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:42.207273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c081a1-fbab-427f-8c9a-d085ad542434 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:42.207847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c081a1-fbab-427f-8c9a-d085ad542434 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:42.207847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c081a1-fbab-427f-8c9a-d085ad542434 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:42.209454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 333/674] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:42.214903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e000783-aec9-4853-91d3-871a50b97b53 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:42.215345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e000783-aec9-4853-91d3-871a50b97b53 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:42.215561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e000783-aec9-4853-91d3-871a50b97b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:42.234630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-9e000783-aec9-4853-91d3-871a50b97b53 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:42.235854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9e000783-aec9-4853-91d3-871a50b97b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:42.312477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 342/675] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:42.460120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa902-eca2-40a1-bffd-a5ecb3be04ca None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:42.460316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa902-eca2-40a1-bffd-a5ecb3be04ca None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:42.460582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa902-eca2-40a1-bffd-a5ecb3be04ca None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:42.462172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 334/676] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:42.468005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25626e33-6f18-4c74-8a5a-bbab2d78edd6 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:42.468297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25626e33-6f18-4c74-8a5a-bbab2d78edd6 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:42.468574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25626e33-6f18-4c74-8a5a-bbab2d78edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:42.487430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-25626e33-6f18-4c74-8a5a-bbab2d78edd6 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:42.488614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-25626e33-6f18-4c74-8a5a-bbab2d78edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:42.541411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:42.563990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 343/677] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:42.591920 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caa902-eca2-40a1-bffd-a5ecb3be04ca None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:42.621684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:42.700106 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caa902-eca2-40a1-bffd-a5ecb3be04ca None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:42.736357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1b530-3c6b-45e8-8565-6d9c807ed05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:42.737530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1b530-3c6b-45e8-8565-6d9c807ed05e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:42.737817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1b530-3c6b-45e8-8565-6d9c807ed05e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:42.738093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1b530-3c6b-45e8-8565-6d9c807ed05e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:42.738754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1b530-3c6b-45e8-8565-6d9c807ed05e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:42.740300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1b530-3c6b-45e8-8565-6d9c807ed05e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-e6f1b530-3c6b-45e8-8565-6d9c807ed05e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:42.750483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:42.751531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:42.753070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 335/678] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Oct 12 04:37:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:42.758300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25626e33-6f18-4c74-8a5a-bbab2d78edd6 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:42.844219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1b530-3c6b-45e8-8565-6d9c807ed05e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:42.864402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25626e33-6f18-4c74-8a5a-bbab2d78edd6 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:42.901207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33fda5-aa78-4629-8db5-d0bb19de60b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:42.901960 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33fda5-aa78-4629-8db5-d0bb19de60b8 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:42.902252 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33fda5-aa78-4629-8db5-d0bb19de60b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:42.902534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33fda5-aa78-4629-8db5-d0bb19de60b8 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:42.903165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33fda5-aa78-4629-8db5-d0bb19de60b8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:42.903502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33fda5-aa78-4629-8db5-d0bb19de60b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:42.904873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33fda5-aa78-4629-8db5-d0bb19de60b8 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:42.909775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 344/679] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:42.910995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1680d6f-b276-4b60-9aa4-0841ee283969 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:42.911325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1680d6f-b276-4b60-9aa4-0841ee283969 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:42.911583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1680d6f-b276-4b60-9aa4-0841ee283969 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:42.915318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 345/680] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:42.915318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1680d6f-b276-4b60-9aa4-0841ee283969 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:42.947959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:42.958188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1b530-3c6b-45e8-8565-6d9c807ed05e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:42.970841 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:42.998518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c82335-c51e-42b5-b4c7-1973965d9cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:42.999122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c82335-c51e-42b5-b4c7-1973965d9cda None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:42.999436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c82335-c51e-42b5-b4c7-1973965d9cda None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.000102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c82335-c51e-42b5-b4c7-1973965d9cda None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.000701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c82335-c51e-42b5-b4c7-1973965d9cda None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:43.002950 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c82335-c51e-42b5-b4c7-1973965d9cda None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-27c82335-c51e-42b5-b4c7-1973965d9cda None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:43.014351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:43.015426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:43.016297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 336/681] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:43.017722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434e6d7-1ca8-47e2-9153-9451768c1dbf None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.017722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434e6d7-1ca8-47e2-9153-9451768c1dbf None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.017968 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434e6d7-1ca8-47e2-9153-9451768c1dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.029159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1680d6f-b276-4b60-9aa4-0841ee283969 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:43.037269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-d434e6d7-1ca8-47e2-9153-9451768c1dbf None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:43.038435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d434e6d7-1ca8-47e2-9153-9451768c1dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:43.066597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36c5c3-3c54-4434-ac11-ce461ffa3980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:43.067202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36c5c3-3c54-4434-ac11-ce461ffa3980 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.067519 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36c5c3-3c54-4434-ac11-ce461ffa3980 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.067797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36c5c3-3c54-4434-ac11-ce461ffa3980 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.068403 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36c5c3-3c54-4434-ac11-ce461ffa3980 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:43.068706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36c5c3-3c54-4434-ac11-ce461ffa3980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:43.070089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36c5c3-3c54-4434-ac11-ce461ffa3980 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:43.075172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 346/682] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:43.080609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36c5c3-3c54-4434-ac11-ce461ffa3980 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:43.108581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 337/683] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:43.112667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434e6d7-1ca8-47e2-9153-9451768c1dbf None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:43.182957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36c5c3-3c54-4434-ac11-ce461ffa3980 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:43.192938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:43.227122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1dc1d-e25b-498b-a0b5-0292199d3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:43.227783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1dc1d-e25b-498b-a0b5-0292199d3a24 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.228039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1dc1d-e25b-498b-a0b5-0292199d3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.228316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1dc1d-e25b-498b-a0b5-0292199d3a24 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.228941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1dc1d-e25b-498b-a0b5-0292199d3a24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:43.229245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1dc1d-e25b-498b-a0b5-0292199d3a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:43.230611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1dc1d-e25b-498b-a0b5-0292199d3a24 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:43.235830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:43.240918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 347/684] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:37:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:43.241978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1dc1d-e25b-498b-a0b5-0292199d3a24 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:43.258815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434e6d7-1ca8-47e2-9153-9451768c1dbf None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:43.312169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90855550-daaa-4b88-92df-26d8cc98c0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:43.313024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90855550-daaa-4b88-92df-26d8cc98c0f0 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.313310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90855550-daaa-4b88-92df-26d8cc98c0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.313584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90855550-daaa-4b88-92df-26d8cc98c0f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.314263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90855550-daaa-4b88-92df-26d8cc98c0f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:43.315720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90855550-daaa-4b88-92df-26d8cc98c0f0 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:43.343348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 338/685] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:37:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:43.363689 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1dc1d-e25b-498b-a0b5-0292199d3a24 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:43.374984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90855550-daaa-4b88-92df-26d8cc98c0f0 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:43.411146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8caa08-60cc-4951-8f45-161290fb9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:43.411812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8caa08-60cc-4951-8f45-161290fb9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.412102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8caa08-60cc-4951-8f45-161290fb9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.412377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8caa08-60cc-4951-8f45-161290fb9ba0 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.413012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8caa08-60cc-4951-8f45-161290fb9ba0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:43.413322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8caa08-60cc-4951-8f45-161290fb9ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:43.414719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8caa08-60cc-4951-8f45-161290fb9ba0 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:43.420311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 348/686] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:37:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:43.421557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe50730-b03d-4881-8eda-ec8fc2c605a4 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.421870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe50730-b03d-4881-8eda-ec8fc2c605a4 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.422213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe50730-b03d-4881-8eda-ec8fc2c605a4 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.423404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 349/687] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:43.426485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe50730-b03d-4881-8eda-ec8fc2c605a4 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:43.462756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:43.494059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90855550-daaa-4b88-92df-26d8cc98c0f0 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:43.535401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271b2b3-3d1e-4652-8996-a7083dce07c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:43.535735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271b2b3-3d1e-4652-8996-a7083dce07c9 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.535999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271b2b3-3d1e-4652-8996-a7083dce07c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.536273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271b2b3-3d1e-4652-8996-a7083dce07c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.541917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe50730-b03d-4881-8eda-ec8fc2c605a4 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:43.545146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:43.549898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271b2b3-3d1e-4652-8996-a7083dce07c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-5271b2b3-3d1e-4652-8996-a7083dce07c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:43.556205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:43.557379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:43.558412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 339/688] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 04:37:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:43.559449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635b10e-c71c-4d9d-9a10-b0edf117ffcc None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.559742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635b10e-c71c-4d9d-9a10-b0edf117ffcc None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.560020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635b10e-c71c-4d9d-9a10-b0edf117ffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.581032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b635b10e-c71c-4d9d-9a10-b0edf117ffcc None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:43.582247 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b635b10e-c71c-4d9d-9a10-b0edf117ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:43.586622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9454bb-4a27-4625-8f35-9d42c839c930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:43.587232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9454bb-4a27-4625-8f35-9d42c839c930 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.587541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9454bb-4a27-4625-8f35-9d42c839c930 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.587814 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9454bb-4a27-4625-8f35-9d42c839c930 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.588503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9454bb-4a27-4625-8f35-9d42c839c930 None admin] RBAC: Adding query filter params (interface=public, service_id=297361f5408342539a2c25a821ff5ce8, region_id=RegionOne) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:43.588810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9454bb-4a27-4625-8f35-9d42c839c930 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:43.590418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9454bb-4a27-4625-8f35-9d42c839c930 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:43.595930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 350/689] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 04:37:43 2022] GET /identity/v3/endpoints?service_id=297361f5408342539a2c25a821ff5ce8&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:43.596770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9454bb-4a27-4625-8f35-9d42c839c930 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:43.660701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 340/690] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:43.661562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635b10e-c71c-4d9d-9a10-b0edf117ffcc None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:43.703072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:43.710702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9454bb-4a27-4625-8f35-9d42c839c930 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:43.747755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e58a8-4a13-4161-86e7-9e500e56b5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:43.748772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e58a8-4a13-4161-86e7-9e500e56b5a8 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.749274 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e58a8-4a13-4161-86e7-9e500e56b5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.749771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e58a8-4a13-4161-86e7-9e500e56b5a8 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.750626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e58a8-4a13-4161-86e7-9e500e56b5a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:43.751180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e58a8-4a13-4161-86e7-9e500e56b5a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:43.753660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e58a8-4a13-4161-86e7-9e500e56b5a8 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:43.763066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 351/691] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Oct 12 04:37:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:43.770054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e58a8-4a13-4161-86e7-9e500e56b5a8 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:43.782922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635b10e-c71c-4d9d-9a10-b0edf117ffcc None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:43.815930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:43.822842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1e60d-7276-4f6d-9e22-cf4b00781945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:43.824088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e60d-7276-4f6d-9e22-cf4b00781945 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.824730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e60d-7276-4f6d-9e22-cf4b00781945 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.825398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e60d-7276-4f6d-9e22-cf4b00781945 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.826005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1e60d-7276-4f6d-9e22-cf4b00781945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:43.827614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1e60d-7276-4f6d-9e22-cf4b00781945 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:43.834580 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 341/692] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 04:37:43 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:37:43.891004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e58a8-4a13-4161-86e7-9e500e56b5a8 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:43.930772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d63d77-e967-4f7a-b585-55e5a0d067cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:43.931862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63d77-e967-4f7a-b585-55e5a0d067cf None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:43.932348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63d77-e967-4f7a-b585-55e5a0d067cf None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:43.932823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d63d77-e967-4f7a-b585-55e5a0d067cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:43.937842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1e60d-7276-4f6d-9e22-cf4b00781945 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:43.946646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d63d77-e967-4f7a-b585-55e5a0d067cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:43.948838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d63d77-e967-4f7a-b585-55e5a0d067cf None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-f6d63d77-e967-4f7a-b585-55e5a0d067cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:43.965917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:43.966929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:43.967853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:43.967853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:43.967853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:43.975261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 352/693] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:43.977079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d63d77-e967-4f7a-b585-55e5a0d067cf None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:43.990804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:44.063056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1e60d-7276-4f6d-9e22-cf4b00781945 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:44.099598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d63d77-e967-4f7a-b585-55e5a0d067cf None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:44.101123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a75e0-29ce-4148-86ef-812b0b2a2271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:44.101833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a75e0-29ce-4148-86ef-812b0b2a2271 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:44.102119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a75e0-29ce-4148-86ef-812b0b2a2271 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:44.102392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a75e0-29ce-4148-86ef-812b0b2a2271 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:44.102977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a75e0-29ce-4148-86ef-812b0b2a2271 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:44.104384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a75e0-29ce-4148-86ef-812b0b2a2271 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-5d9a75e0-29ce-4148-86ef-812b0b2a2271 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:44.114071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:44.115103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:44.115982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 342/694] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:37:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:44.121112 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a75e0-29ce-4148-86ef-812b0b2a2271 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:44.146194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49ca63-2208-4a7f-810b-17e656f21d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:44.146821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49ca63-2208-4a7f-810b-17e656f21d71 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:44.147103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49ca63-2208-4a7f-810b-17e656f21d71 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:44.147409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49ca63-2208-4a7f-810b-17e656f21d71 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:44.148206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49ca63-2208-4a7f-810b-17e656f21d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:44.148516 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49ca63-2208-4a7f-810b-17e656f21d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:44.150441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49ca63-2208-4a7f-810b-17e656f21d71 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:44.171368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 353/695] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:44.173709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49ca63-2208-4a7f-810b-17e656f21d71 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:44.193271 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:44.245821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a75e0-29ce-4148-86ef-812b0b2a2271 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:44.269676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:44.292187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656a65e-3f0e-4e53-893c-f4303716457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:44.292805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656a65e-3f0e-4e53-893c-f4303716457a None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:44.293086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656a65e-3f0e-4e53-893c-f4303716457a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:44.293361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656a65e-3f0e-4e53-893c-f4303716457a None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:44.294059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656a65e-3f0e-4e53-893c-f4303716457a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:44.294371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656a65e-3f0e-4e53-893c-f4303716457a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:44.296335 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656a65e-3f0e-4e53-893c-f4303716457a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:44.307323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 343/696] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:37:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:44.312352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656a65e-3f0e-4e53-893c-f4303716457a None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:44.314002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49ca63-2208-4a7f-810b-17e656f21d71 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:44.357536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123168a-a795-4d75-bdd1-b598564948d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:44.358087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123168a-a795-4d75-bdd1-b598564948d8 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:44.358363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123168a-a795-4d75-bdd1-b598564948d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:44.358631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123168a-a795-4d75-bdd1-b598564948d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:44.371075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123168a-a795-4d75-bdd1-b598564948d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:44.373148 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123168a-a795-4d75-bdd1-b598564948d8 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-2123168a-a795-4d75-bdd1-b598564948d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:44.387419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:44.388573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:44.389700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:44.389700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:44.389700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:44.389700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:44.389700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:44.389700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:44.389700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:44.389700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:44.389700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 04:37:44.389700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:44.395926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 354/697] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 04:37:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:44.398197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123168a-a795-4d75-bdd1-b598564948d8 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:44.463620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656a65e-3f0e-4e53-893c-f4303716457a None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:44.492532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:44.506297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0732-4db8-458d-9f1b-d8df10e63752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:44.507039 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0732-4db8-458d-9f1b-d8df10e63752 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:44.507655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0732-4db8-458d-9f1b-d8df10e63752 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:44.507766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0732-4db8-458d-9f1b-d8df10e63752 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:44.508504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b0732-4db8-458d-9f1b-d8df10e63752 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:44.508898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b0732-4db8-458d-9f1b-d8df10e63752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:44.510330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b0732-4db8-458d-9f1b-d8df10e63752 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:44.511246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123168a-a795-4d75-bdd1-b598564948d8 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:44.516247 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 344/698] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:37:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:44.523089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0732-4db8-458d-9f1b-d8df10e63752 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:44.547520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:44.556074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c98489-0b31-44a6-a165-4820c66a4cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:44.557176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98489-0b31-44a6-a165-4820c66a4cff None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:44.557632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98489-0b31-44a6-a165-4820c66a4cff None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:44.558051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98489-0b31-44a6-a165-4820c66a4cff None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:44.559473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c98489-0b31-44a6-a165-4820c66a4cff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:44.559781 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c98489-0b31-44a6-a165-4820c66a4cff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:44.561938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c98489-0b31-44a6-a165-4820c66a4cff None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:44.585050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 355/699] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Oct 12 04:37:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:44.587203 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c98489-0b31-44a6-a165-4820c66a4cff None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:44.662428 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0732-4db8-458d-9f1b-d8df10e63752 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:44.690687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c98489-0b31-44a6-a165-4820c66a4cff None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:44.710530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac3074-c75d-4c48-99de-7797d9d76fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:44.711138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3074-c75d-4c48-99de-7797d9d76fb2 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:44.711439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3074-c75d-4c48-99de-7797d9d76fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:44.711709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3074-c75d-4c48-99de-7797d9d76fb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:44.712401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac3074-c75d-4c48-99de-7797d9d76fb2 None admin] RBAC: Adding query filter params (interface=public, service_id=69d48940adc546669dac5f871704f4db, region_id=RegionOne) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:44.712708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac3074-c75d-4c48-99de-7797d9d76fb2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:44.714058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac3074-c75d-4c48-99de-7797d9d76fb2 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:44.724912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 345/700] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 04:37:44 2022] GET /identity/v3/endpoints?service_id=69d48940adc546669dac5f871704f4db&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:44.725769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac3074-c75d-4c48-99de-7797d9d76fb2 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:44.739892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9713732-c3fe-46f7-a336-d6c7dd18513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:44.741061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713732-c3fe-46f7-a336-d6c7dd18513a None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:44.741542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713732-c3fe-46f7-a336-d6c7dd18513a None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:44.742519 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713732-c3fe-46f7-a336-d6c7dd18513a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:44.778550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:44.825261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:44.832956 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac3074-c75d-4c48-99de-7797d9d76fb2 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:44.844223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9713732-c3fe-46f7-a336-d6c7dd18513a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:44.846583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9713732-c3fe-46f7-a336-d6c7dd18513a None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:44.874798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee63c10-4bc3-4c5d-a178-51cd36a8b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:44.876003 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63c10-4bc3-4c5d-a178-51cd36a8b31e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:44.876846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63c10-4bc3-4c5d-a178-51cd36a8b31e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:44.877660 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63c10-4bc3-4c5d-a178-51cd36a8b31e None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:44.878713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee63c10-4bc3-4c5d-a178-51cd36a8b31e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:44.880671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee63c10-4bc3-4c5d-a178-51cd36a8b31e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:44.891664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 346/701] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 04:37:44 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:37:44.967265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 356/702] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:37:44 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:37:44.969037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee63c10-4bc3-4c5d-a178-51cd36a8b31e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:45.083010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee63c10-4bc3-4c5d-a178-51cd36a8b31e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:45.098373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:45.121531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541882d-780f-4408-9c72-17235049e6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:45.122526 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541882d-780f-4408-9c72-17235049e6e0 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:45.123030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541882d-780f-4408-9c72-17235049e6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:45.123529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541882d-780f-4408-9c72-17235049e6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:45.135903 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541882d-780f-4408-9c72-17235049e6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:45.137671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541882d-780f-4408-9c72-17235049e6e0 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-b541882d-780f-4408-9c72-17235049e6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:45.153063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:45.154016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:45.154905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:45.154905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:45.154905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:45.161201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 347/703] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:45.162835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9713732-c3fe-46f7-a336-d6c7dd18513a None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:45.257410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:45.270890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9713732-c3fe-46f7-a336-d6c7dd18513a None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:45.307115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eb391-685e-473e-94cd-e05cf5ffa8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:45.307998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eb391-685e-473e-94cd-e05cf5ffa8ec None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:45.308453 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eb391-685e-473e-94cd-e05cf5ffa8ec None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:45.308873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eb391-685e-473e-94cd-e05cf5ffa8ec None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:45.309645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eb391-685e-473e-94cd-e05cf5ffa8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:45.310091 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eb391-685e-473e-94cd-e05cf5ffa8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:45.311611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eb391-685e-473e-94cd-e05cf5ffa8ec None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:45.328430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 357/704] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:45.329961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541882d-780f-4408-9c72-17235049e6e0 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:45.438885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541882d-780f-4408-9c72-17235049e6e0 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:45.476172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fdf5b-ce0d-4416-a42e-b6eeabc9c84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:45.477050 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fdf5b-ce0d-4416-a42e-b6eeabc9c84d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:45.477504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fdf5b-ce0d-4416-a42e-b6eeabc9c84d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:45.477921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fdf5b-ce0d-4416-a42e-b6eeabc9c84d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:45.485275 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fdf5b-ce0d-4416-a42e-b6eeabc9c84d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:45.487113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fdf5b-ce0d-4416-a42e-b6eeabc9c84d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-e37fdf5b-ce0d-4416-a42e-b6eeabc9c84d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:45.500385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:45.501547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:45.503167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:45.503167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:45.503167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:45.503167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:45.503167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:45.503167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:45.503167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:45.503167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:45.510204 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 348/705] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:45.511952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eb391-685e-473e-94cd-e05cf5ffa8ec None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:45.621152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eb391-685e-473e-94cd-e05cf5ffa8ec None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:45.628510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819166fb-ecc6-45f4-95a7-308b00d4f4a2 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:45.629104 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819166fb-ecc6-45f4-95a7-308b00d4f4a2 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:45.629589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819166fb-ecc6-45f4-95a7-308b00d4f4a2 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:45.631415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 349/706] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:45.636708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037093f7-a602-4924-8203-61113dd1fb52 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:45.637256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037093f7-a602-4924-8203-61113dd1fb52 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:45.637738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037093f7-a602-4924-8203-61113dd1fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:45.656723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-037093f7-a602-4924-8203-61113dd1fb52 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:45.658303 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-037093f7-a602-4924-8203-61113dd1fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:45.660734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bc0eb-6e62-4f79-b264-61c945714795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:45.661352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bc0eb-6e62-4f79-b264-61c945714795 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:45.661633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bc0eb-6e62-4f79-b264-61c945714795 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:45.661909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bc0eb-6e62-4f79-b264-61c945714795 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:45.663589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bc0eb-6e62-4f79-b264-61c945714795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:45.663903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bc0eb-6e62-4f79-b264-61c945714795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:45.665322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bc0eb-6e62-4f79-b264-61c945714795 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:45.681108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 358/707] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:37:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:45.689533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:45.689764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bc0eb-6e62-4f79-b264-61c945714795 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:45.701502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:45.741760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 350/708] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:45.804901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bc0eb-6e62-4f79-b264-61c945714795 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:45.841742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2a233-3ccc-4d4d-9607-122a587118b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:45.842622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2a233-3ccc-4d4d-9607-122a587118b5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:45.843113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2a233-3ccc-4d4d-9607-122a587118b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:45.843612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2a233-3ccc-4d4d-9607-122a587118b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:45.844507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2a233-3ccc-4d4d-9607-122a587118b5 None admin] RBAC: Adding query filter params (role.id=cea949ae420a46e18943f9f02af359b7, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=91d54c81edf4416488d569bd1377bbf5) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:45.844996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2a233-3ccc-4d4d-9607-122a587118b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:45.846685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2a233-3ccc-4d4d-9607-122a587118b5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:45.853115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 359/709] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:37:45 2022] GET /identity/v3/role_assignments?user.id=91d54c81edf4416488d569bd1377bbf5&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=cea949ae420a46e18943f9f02af359b7 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:46.020921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037093f7-a602-4924-8203-61113dd1fb52 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:46.098522 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cf40f-0862-4d3f-9e00-b86edfa288c8 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:46.099149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cf40f-0862-4d3f-9e00-b86edfa288c8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:46.099677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cf40f-0862-4d3f-9e00-b86edfa288c8 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:46.101505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 360/710] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:46.111309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234c2e1-7b1c-445d-b159-e44e4ce5e972 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:46.111309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234c2e1-7b1c-445d-b159-e44e4ce5e972 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:46.111309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234c2e1-7b1c-445d-b159-e44e4ce5e972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:46.129176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2234c2e1-7b1c-445d-b159-e44e4ce5e972 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:46.130122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037093f7-a602-4924-8203-61113dd1fb52 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:46.130413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2234c2e1-7b1c-445d-b159-e44e4ce5e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:46.166406 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e08e0-4788-4709-8598-d97caca969f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:46.167036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e08e0-4788-4709-8598-d97caca969f5 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:46.167335 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e08e0-4788-4709-8598-d97caca969f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:46.167618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e08e0-4788-4709-8598-d97caca969f5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:46.168201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e08e0-4788-4709-8598-d97caca969f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:46.169617 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e08e0-4788-4709-8598-d97caca969f5 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-be0e08e0-4788-4709-8598-d97caca969f5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:46.178692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:46.179761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:46.180612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 351/711] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:46.188227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e08e0-4788-4709-8598-d97caca969f5 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:46.222033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 361/712] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:46.226438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:46.309072 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e08e0-4788-4709-8598-d97caca969f5 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:46.343802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4956c-cfa4-4f90-a9cf-8155228cb87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:46.344429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4956c-cfa4-4f90-a9cf-8155228cb87d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:46.344679 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4956c-cfa4-4f90-a9cf-8155228cb87d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:46.344959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4956c-cfa4-4f90-a9cf-8155228cb87d None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:46.345583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4956c-cfa4-4f90-a9cf-8155228cb87d None admin] RBAC: Adding query filter params (name=compute) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:46.345890 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4956c-cfa4-4f90-a9cf-8155228cb87d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:46.347337 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4956c-cfa4-4f90-a9cf-8155228cb87d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:46.352491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 352/713] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:46.358080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234c2e1-7b1c-445d-b159-e44e4ce5e972 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:46.360913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:46.466535 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234c2e1-7b1c-445d-b159-e44e4ce5e972 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:46.496142 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4956c-cfa4-4f90-a9cf-8155228cb87d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:46.502225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73fcf-e600-42e0-b5b4-e744de18c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:46.502903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73fcf-e600-42e0-b5b4-e744de18c0d9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:46.503188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73fcf-e600-42e0-b5b4-e744de18c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:46.503494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a73fcf-e600-42e0-b5b4-e744de18c0d9 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:46.504123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73fcf-e600-42e0-b5b4-e744de18c0d9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:46.504428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73fcf-e600-42e0-b5b4-e744de18c0d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:46.505790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a73fcf-e600-42e0-b5b4-e744de18c0d9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:46.512341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 362/714] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:46.597496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:46.616971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4956c-cfa4-4f90-a9cf-8155228cb87d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:46.655396 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b0268-ee84-45b3-8f93-429baf62203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:46.656058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0268-ee84-45b3-8f93-429baf62203e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:46.656341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0268-ee84-45b3-8f93-429baf62203e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:46.656616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0268-ee84-45b3-8f93-429baf62203e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:46.657219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b0268-ee84-45b3-8f93-429baf62203e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:46.658730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b0268-ee84-45b3-8f93-429baf62203e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-1b7b0268-ee84-45b3-8f93-429baf62203e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:46.668618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:46.670981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:46.672958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 353/715] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:46.679312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73fcf-e600-42e0-b5b4-e744de18c0d9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:46.749001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:46.790442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a73fcf-e600-42e0-b5b4-e744de18c0d9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:46.828461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33aec9-0963-400c-9ed2-21e361d90eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:46.829083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33aec9-0963-400c-9ed2-21e361d90eaf None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:46.829367 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33aec9-0963-400c-9ed2-21e361d90eaf None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:46.829649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33aec9-0963-400c-9ed2-21e361d90eaf None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:46.830286 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33aec9-0963-400c-9ed2-21e361d90eaf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:46.830712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33aec9-0963-400c-9ed2-21e361d90eaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:46.832162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33aec9-0963-400c-9ed2-21e361d90eaf None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:46.837506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 363/716] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:37:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:46.843435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b0268-ee84-45b3-8f93-429baf62203e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:46.946833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b0268-ee84-45b3-8f93-429baf62203e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:46.983346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ca300-326a-496b-922c-b0b5b8996d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:46.983993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ca300-326a-496b-922c-b0b5b8996d17 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:46.984278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ca300-326a-496b-922c-b0b5b8996d17 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:46.984632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ca300-326a-496b-922c-b0b5b8996d17 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:46.985362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ca300-326a-496b-922c-b0b5b8996d17 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:46.985726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ca300-326a-496b-922c-b0b5b8996d17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:46.987235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ca300-326a-496b-922c-b0b5b8996d17 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:46.993480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 354/717] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:37:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:46.999401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33aec9-0963-400c-9ed2-21e361d90eaf None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:47.099190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ac43-322e-4b85-ad65-2041775e455c None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:47.099569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ac43-322e-4b85-ad65-2041775e455c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:47.099778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ac43-322e-4b85-ad65-2041775e455c None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:47.101244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 355/718] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:47.106358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5f65-3055-466f-9b3e-20e717f75349 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:47.106850 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5f65-3055-466f-9b3e-20e717f75349 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:47.107378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5f65-3055-466f-9b3e-20e717f75349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:47.112372 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33aec9-0963-400c-9ed2-21e361d90eaf None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:47.126488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-fd0a5f65-3055-466f-9b3e-20e717f75349 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:47.128203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fd0a5f65-3055-466f-9b3e-20e717f75349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:47.136408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:47.144616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:47.151107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162360d9-0704-4b53-9c9d-cdfac1da685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:47.151758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162360d9-0704-4b53-9c9d-cdfac1da685e None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:47.152043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162360d9-0704-4b53-9c9d-cdfac1da685e None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:47.152379 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162360d9-0704-4b53-9c9d-cdfac1da685e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:47.153047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162360d9-0704-4b53-9c9d-cdfac1da685e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:47.154417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162360d9-0704-4b53-9c9d-cdfac1da685e None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:47.177810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 364/719] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:37:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:47.225497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 356/720] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:47.500326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162360d9-0704-4b53-9c9d-cdfac1da685e None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:47.615715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162360d9-0704-4b53-9c9d-cdfac1da685e None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:47.650760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1abc8a-ebda-4432-bead-e243c71b1170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:47.651508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1abc8a-ebda-4432-bead-e243c71b1170 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:47.651800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1abc8a-ebda-4432-bead-e243c71b1170 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:47.652077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1abc8a-ebda-4432-bead-e243c71b1170 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:47.652711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1abc8a-ebda-4432-bead-e243c71b1170 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:47.654074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1abc8a-ebda-4432-bead-e243c71b1170 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-1b1abc8a-ebda-4432-bead-e243c71b1170 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:47.663671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:47.664651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:47.665470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 365/721] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:37:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:47.676656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a5f65-3055-466f-9b3e-20e717f75349 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:47.782210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a5f65-3055-466f-9b3e-20e717f75349 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:47.823304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e730f-a500-4bcc-9786-d10c6574dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:47.823933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e730f-a500-4bcc-9786-d10c6574dd37 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:47.824219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e730f-a500-4bcc-9786-d10c6574dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:47.824499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e730f-a500-4bcc-9786-d10c6574dd37 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:47.825130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e730f-a500-4bcc-9786-d10c6574dd37 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:47.825438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e730f-a500-4bcc-9786-d10c6574dd37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:47.826825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e730f-a500-4bcc-9786-d10c6574dd37 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:47.832679 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 357/722] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:37:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:47.838166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1abc8a-ebda-4432-bead-e243c71b1170 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:47.891979 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:47.944996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1abc8a-ebda-4432-bead-e243c71b1170 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:47.983315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d1274-7408-4175-a301-71aa39221b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:47.983315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d1274-7408-4175-a301-71aa39221b5e None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:47.983315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d1274-7408-4175-a301-71aa39221b5e None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:47.983315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d1274-7408-4175-a301-71aa39221b5e None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:47.983724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d1274-7408-4175-a301-71aa39221b5e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:47.983724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d1274-7408-4175-a301-71aa39221b5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:47.985061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d1274-7408-4175-a301-71aa39221b5e None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:47.991017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 366/723] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Oct 12 04:37:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:47.996628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e730f-a500-4bcc-9786-d10c6574dd37 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:48.000291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:48.108046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e730f-a500-4bcc-9786-d10c6574dd37 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:48.128014 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc5461-32bf-4b33-93c9-66f852b28005 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:48.128326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc5461-32bf-4b33-93c9-66f852b28005 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:48.128590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc5461-32bf-4b33-93c9-66f852b28005 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:48.130194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 367/724] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:48.139479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc2bda-0914-419a-a904-2865110e4e39 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:48.139890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc2bda-0914-419a-a904-2865110e4e39 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:48.140514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc2bda-0914-419a-a904-2865110e4e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:48.148572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51a316-4d72-4db2-85f6-534536ca6fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:48.149191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51a316-4d72-4db2-85f6-534536ca6fa2 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:48.149482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51a316-4d72-4db2-85f6-534536ca6fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:48.149755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51a316-4d72-4db2-85f6-534536ca6fa2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:48.150439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51a316-4d72-4db2-85f6-534536ca6fa2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:48.151851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51a316-4d72-4db2-85f6-534536ca6fa2 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:48.164980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-3ffc2bda-0914-419a-a904-2865110e4e39 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:48.166187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3ffc2bda-0914-419a-a904-2865110e4e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:48.175449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 358/725] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:37:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:48.266730 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 368/726] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:48.538313 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51a316-4d72-4db2-85f6-534536ca6fa2 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:48.598930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:48.644422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51a316-4d72-4db2-85f6-534536ca6fa2 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:48.682410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9a1c3-d4e4-4ed3-bcb3-2fb4e3ea7236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:48.683148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a1c3-d4e4-4ed3-bcb3-2fb4e3ea7236 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:48.683387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a1c3-d4e4-4ed3-bcb3-2fb4e3ea7236 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:48.683605 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a1c3-d4e4-4ed3-bcb3-2fb4e3ea7236 None admin] PATH_INFO: `/v3/services/image` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:48.684188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9a1c3-d4e4-4ed3-bcb3-2fb4e3ea7236 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:48.685545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9a1c3-d4e4-4ed3-bcb3-2fb4e3ea7236 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-4bc9a1c3-d4e4-4ed3-bcb3-2fb4e3ea7236 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:48.694416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:48.695450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:48.696285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 359/727] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Oct 12 04:37:48 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:48.701675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc2bda-0914-419a-a904-2865110e4e39 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:48.746463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:48.762372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637e40-60c0-4a93-aecd-1c576c7a5cbd None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:48.762814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637e40-60c0-4a93-aecd-1c576c7a5cbd None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:48.763092 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637e40-60c0-4a93-aecd-1c576c7a5cbd None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:48.764905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 360/728] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:48.772432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9bfdb-f145-4c40-bd98-8360385ad616 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:48.772715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9bfdb-f145-4c40-bd98-8360385ad616 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:48.773038 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9bfdb-f145-4c40-bd98-8360385ad616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:48.791154 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5aa9bfdb-f145-4c40-bd98-8360385ad616 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:48.792302 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5aa9bfdb-f145-4c40-bd98-8360385ad616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:48.810112 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc2bda-0914-419a-a904-2865110e4e39 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:48.847717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62108-02d1-4f80-ba43-ca0f02b4bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:48.848473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62108-02d1-4f80-ba43-ca0f02b4bc14 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:48.848876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62108-02d1-4f80-ba43-ca0f02b4bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:48.849252 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62108-02d1-4f80-ba43-ca0f02b4bc14 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:48.850117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62108-02d1-4f80-ba43-ca0f02b4bc14 None admin] RBAC: Adding query filter params (name=image) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:48.850659 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62108-02d1-4f80-ba43-ca0f02b4bc14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:48.852139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62108-02d1-4f80-ba43-ca0f02b4bc14 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:48.861986 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 369/729] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:48.867040 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62108-02d1-4f80-ba43-ca0f02b4bc14 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:48.868589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 361/730] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:48.970471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62108-02d1-4f80-ba43-ca0f02b4bc14 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:48.973349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:49.006328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5104a5d-d179-4b57-8bd5-edcdb435ac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:49.006988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5104a5d-d179-4b57-8bd5-edcdb435ac8d None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:49.007269 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5104a5d-d179-4b57-8bd5-edcdb435ac8d None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:49.007566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5104a5d-d179-4b57-8bd5-edcdb435ac8d None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:49.008186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5104a5d-d179-4b57-8bd5-edcdb435ac8d None admin] RBAC: Adding query filter params (type=image) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:49.008489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5104a5d-d179-4b57-8bd5-edcdb435ac8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:49.009903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5104a5d-d179-4b57-8bd5-edcdb435ac8d None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:49.014701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 370/731] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:49.154642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9bfdb-f145-4c40-bd98-8360385ad616 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:49.211638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:49.262508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9bfdb-f145-4c40-bd98-8360385ad616 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:49.300919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7e0a0-377e-4290-8b93-a2b221b6aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:49.301907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e0a0-377e-4290-8b93-a2b221b6aa13 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:49.302393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e0a0-377e-4290-8b93-a2b221b6aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:49.302902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e0a0-377e-4290-8b93-a2b221b6aa13 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:49.303792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7e0a0-377e-4290-8b93-a2b221b6aa13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:49.305346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7e0a0-377e-4290-8b93-a2b221b6aa13 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:49.327461 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 362/732] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:37:49 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:49.589936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4d96-a837-488d-a32c-ebae82d3245a None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:49.590228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4d96-a837-488d-a32c-ebae82d3245a None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:49.590510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4d96-a837-488d-a32c-ebae82d3245a None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:49.592188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 371/733] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:49.597685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bcd76-09ff-4ede-8057-4dac5185ee23 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:49.597983 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bcd76-09ff-4ede-8057-4dac5185ee23 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:49.598262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bcd76-09ff-4ede-8057-4dac5185ee23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:49.617674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-3d9bcd76-09ff-4ede-8057-4dac5185ee23 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:49.618869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-3d9bcd76-09ff-4ede-8057-4dac5185ee23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:49.699513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 363/734] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:49.970740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce4d96-a837-488d-a32c-ebae82d3245a None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:50.079987 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce4d96-a837-488d-a32c-ebae82d3245a None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:50.115757 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f88b0-7287-4f18-9f07-450eb88df14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:50.116751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f88b0-7287-4f18-9f07-450eb88df14b None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:50.117258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f88b0-7287-4f18-9f07-450eb88df14b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:50.117731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f88b0-7287-4f18-9f07-450eb88df14b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:50.118495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f88b0-7287-4f18-9f07-450eb88df14b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:50.120069 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f88b0-7287-4f18-9f07-450eb88df14b None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-e00f88b0-7287-4f18-9f07-450eb88df14b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:50.129060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:50.130021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:50.130852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:50.133571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 372/735] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:50.141033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bcd76-09ff-4ede-8057-4dac5185ee23 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:50.181578 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:50.244459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bcd76-09ff-4ede-8057-4dac5185ee23 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:50.281894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528c3db-5769-447e-bf4f-45256bd80b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:50.282905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528c3db-5769-447e-bf4f-45256bd80b72 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:50.283536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528c3db-5769-447e-bf4f-45256bd80b72 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:50.284014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528c3db-5769-447e-bf4f-45256bd80b72 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:50.284922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528c3db-5769-447e-bf4f-45256bd80b72 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:50.285449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528c3db-5769-447e-bf4f-45256bd80b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:50.287129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528c3db-5769-447e-bf4f-45256bd80b72 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:50.293245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 364/736] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:37:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:50.300560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f88b0-7287-4f18-9f07-450eb88df14b None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:50.337102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:50.415507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f88b0-7287-4f18-9f07-450eb88df14b None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:50.438971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ed42-01bb-470a-b9ad-f11511136ba8 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:50.439376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ed42-01bb-470a-b9ad-f11511136ba8 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:50.439867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ed42-01bb-470a-b9ad-f11511136ba8 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:50.441582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 365/737] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:50.446969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea5dcf-d21f-4bda-8a51-b75b4360331f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:50.447385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea5dcf-d21f-4bda-8a51-b75b4360331f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:50.447776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea5dcf-d21f-4bda-8a51-b75b4360331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:50.452664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb89e2-dbb1-4041-a765-3aaf7fb7d23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:50.453526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb89e2-dbb1-4041-a765-3aaf7fb7d23f None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:50.453976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb89e2-dbb1-4041-a765-3aaf7fb7d23f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:50.454391 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb89e2-dbb1-4041-a765-3aaf7fb7d23f None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:50.455170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb89e2-dbb1-4041-a765-3aaf7fb7d23f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:50.455648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb89e2-dbb1-4041-a765-3aaf7fb7d23f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:50.457153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb89e2-dbb1-4041-a765-3aaf7fb7d23f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:50.462775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 373/738] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:37:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:50.467990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-88ea5dcf-d21f-4bda-8a51-b75b4360331f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:50.468731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-88ea5dcf-d21f-4bda-8a51-b75b4360331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:50.469138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb89e2-dbb1-4041-a765-3aaf7fb7d23f None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:50.551493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 366/739] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:50.577338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:50.584903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb89e2-dbb1-4041-a765-3aaf7fb7d23f None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:50.619837 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad87edb-1177-4ed7-9219-05cf3e48eed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:50.620452 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad87edb-1177-4ed7-9219-05cf3e48eed9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:50.620736 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad87edb-1177-4ed7-9219-05cf3e48eed9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:50.621014 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad87edb-1177-4ed7-9219-05cf3e48eed9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:50.621713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad87edb-1177-4ed7-9219-05cf3e48eed9 None admin] RBAC: Adding query filter params (interface=admin, service_id=297361f5408342539a2c25a821ff5ce8, region_id=RegionOne) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:50.622027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad87edb-1177-4ed7-9219-05cf3e48eed9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:50.623481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad87edb-1177-4ed7-9219-05cf3e48eed9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:50.633214 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 374/740] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Oct 12 04:37:50 2022] GET /identity/v3/endpoints?service_id=297361f5408342539a2c25a821ff5ce8&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:50.638623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea5dcf-d21f-4bda-8a51-b75b4360331f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:50.671486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:50.746943 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea5dcf-d21f-4bda-8a51-b75b4360331f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:50.782690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15260d1-362f-4b45-b7bf-6880dc37e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:50.783863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15260d1-362f-4b45-b7bf-6880dc37e698 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:50.784228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15260d1-362f-4b45-b7bf-6880dc37e698 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:50.784510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15260d1-362f-4b45-b7bf-6880dc37e698 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:50.785113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15260d1-362f-4b45-b7bf-6880dc37e698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:50.786487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15260d1-362f-4b45-b7bf-6880dc37e698 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:50.793186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 367/741] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 04:37:50 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:37:50.818802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad87edb-1177-4ed7-9219-05cf3e48eed9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:50.936533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad87edb-1177-4ed7-9219-05cf3e48eed9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:50.973364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:50.974005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:50.974243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:50.974520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:50.975173 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:50.977766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:50.979883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WARNING keystone.server.flask.common [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 04:37:50.998697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.sql.core [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 04:37:50.998697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 04:37:50.998697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [parameters: {'id': 'e83ce3107ff84b90b66719e4e2c5f46f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 04:37:50.998697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93090) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e83ce3107ff84b90b66719e4e2c5f46f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e83ce3107ff84b90b66719e4e2c5f46f. Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application conn.query(q) Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 04:37:51.005655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result.read() Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 04:37:51.006472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application next(self.gen) Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application yield resource Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application next(self.gen) Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise self.value Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application session.commit() Oct 12 04:37:51.011975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.session.flush() Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application compat.raise_( Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 04:37:51.012889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 04:37:51.013790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application conn.query(q) Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result.read() Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 04:37:51.014605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [parameters: {'id': 'e83ce3107ff84b90b66719e4e2c5f46f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:51.015567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:51.017006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:51.019399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:51.019399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 12 04:37:51.019399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 12 04:37:51.019399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:51.019399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:51.019399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 04:37:51.019399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 04:37:51.019399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e83ce3107ff84b90b66719e4e2c5f46f. Oct 12 04:37:51.019399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:51.019399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 375/742] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Oct 12 04:37:50 2022] POST /identity/v3/projects => generated 262 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:51.020498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15260d1-362f-4b45-b7bf-6880dc37e698 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:51.120655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:51.126297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15260d1-362f-4b45-b7bf-6880dc37e698 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:51.167272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d58c8-7571-41d2-a8d4-a4116858df17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:51.168392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d58c8-7571-41d2-a8d4-a4116858df17 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:51.168886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d58c8-7571-41d2-a8d4-a4116858df17 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:51.169364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d58c8-7571-41d2-a8d4-a4116858df17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:51.178234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d58c8-7571-41d2-a8d4-a4116858df17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:51.180106 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d58c8-7571-41d2-a8d4-a4116858df17 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-056d58c8-7571-41d2-a8d4-a4116858df17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:37:51.192771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:51.193716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:51.194600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:37:51.194600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:37:51.194600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:37:51.194600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:37:51.194600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:37:51.194600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:37:51.194600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:37:51.194600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:51.197044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 368/743] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:51.203392 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:51.223394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:51.274746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4fc9d-ede6-4229-b475-f2842166da1c None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:51.275077 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4fc9d-ede6-4229-b475-f2842166da1c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:51.275331 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4fc9d-ede6-4229-b475-f2842166da1c None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:51.277228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 369/744] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:51.284334 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321618d8-de44-41c6-afa5-38f31b211c56 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:51.284895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321618d8-de44-41c6-afa5-38f31b211c56 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:51.285377 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321618d8-de44-41c6-afa5-38f31b211c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:51.303711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-321618d8-de44-41c6-afa5-38f31b211c56 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:51.305256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-321618d8-de44-41c6-afa5-38f31b211c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:51.322666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d09dee-eba7-43f2-87f6-3e8f017d87f7 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:51.369573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9e535-ca1d-426c-bbcb-7622b86c06a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:51.370194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9e535-ca1d-426c-bbcb-7622b86c06a9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:51.370477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9e535-ca1d-426c-bbcb-7622b86c06a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:51.370807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9e535-ca1d-426c-bbcb-7622b86c06a9 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:51.371852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9e535-ca1d-426c-bbcb-7622b86c06a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:51.372162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9e535-ca1d-426c-bbcb-7622b86c06a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:51.374335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9e535-ca1d-426c-bbcb-7622b86c06a9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:51.387738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 370/745] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:51.403430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 376/746] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:51.645572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390a1d5-49f6-46aa-9df3-5e4f33db2c78 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:51.645881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390a1d5-49f6-46aa-9df3-5e4f33db2c78 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:51.646047 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390a1d5-49f6-46aa-9df3-5e4f33db2c78 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:51.647669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 371/747] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:51.653008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3eb9e-6651-4b98-b725-5d4af4592022 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:51.653306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3eb9e-6651-4b98-b725-5d4af4592022 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:51.653587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3eb9e-6651-4b98-b725-5d4af4592022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:51.668668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390a1d5-49f6-46aa-9df3-5e4f33db2c78 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:51.674573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-aec3eb9e-6651-4b98-b725-5d4af4592022 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:51.676122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-aec3eb9e-6651-4b98-b725-5d4af4592022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:51.767527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 377/748] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:51.784069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:51.794695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390a1d5-49f6-46aa-9df3-5e4f33db2c78 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:51.830738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3c44f-c7bd-476b-b1c1-2d7fcb9eb0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:51.831382 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3c44f-c7bd-476b-b1c1-2d7fcb9eb0c4 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:51.831666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3c44f-c7bd-476b-b1c1-2d7fcb9eb0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:51.831941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3c44f-c7bd-476b-b1c1-2d7fcb9eb0c4 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:51.832606 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3c44f-c7bd-476b-b1c1-2d7fcb9eb0c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:51.833974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3c44f-c7bd-476b-b1c1-2d7fcb9eb0c4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:51.851248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 372/749] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:37:51 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:37:52.044382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3eb9e-6651-4b98-b725-5d4af4592022 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:52.053028 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:52.153440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3eb9e-6651-4b98-b725-5d4af4592022 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:52.197688 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b47c5a-d8f0-48c7-ac3e-c1c6b6ace63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:52.198328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b47c5a-d8f0-48c7-ac3e-c1c6b6ace63c None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:52.198613 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b47c5a-d8f0-48c7-ac3e-c1c6b6ace63c None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:52.198889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b47c5a-d8f0-48c7-ac3e-c1c6b6ace63c None admin] PATH_INFO: `/v3/services/compute` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:52.199494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b47c5a-d8f0-48c7-ac3e-c1c6b6ace63c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:52.200874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b47c5a-d8f0-48c7-ac3e-c1c6b6ace63c None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-d6b47c5a-d8f0-48c7-ac3e-c1c6b6ace63c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:52.209926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:52.210894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:52.211753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 378/750] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:52.219169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3c44f-c7bd-476b-b1c1-2d7fcb9eb0c4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:52.322119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3c44f-c7bd-476b-b1c1-2d7fcb9eb0c4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:52.358365 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c0e1d-8cae-4d28-b556-26627cbf46ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:52.359344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c0e1d-8cae-4d28-b556-26627cbf46ba None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:52.359821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c0e1d-8cae-4d28-b556-26627cbf46ba None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:52.360306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c0e1d-8cae-4d28-b556-26627cbf46ba None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:52.361239 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c0e1d-8cae-4d28-b556-26627cbf46ba None admin] RBAC: Adding query filter params (name=compute) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:52.362261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c0e1d-8cae-4d28-b556-26627cbf46ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:52.363909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c0e1d-8cae-4d28-b556-26627cbf46ba None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:52.369163 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 373/751] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:52.374932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b47c5a-d8f0-48c7-ac3e-c1c6b6ace63c None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:52.447513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:52.489481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b47c5a-d8f0-48c7-ac3e-c1c6b6ace63c None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:52.524851 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43c24-bbbc-4bce-b980-60a8133c5209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:52.525826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43c24-bbbc-4bce-b980-60a8133c5209 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:52.526345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43c24-bbbc-4bce-b980-60a8133c5209 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:52.526836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43c24-bbbc-4bce-b980-60a8133c5209 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:52.527689 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d43c24-bbbc-4bce-b980-60a8133c5209 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:52.528196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d43c24-bbbc-4bce-b980-60a8133c5209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:52.529751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d43c24-bbbc-4bce-b980-60a8133c5209 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:52.535343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 379/752] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:52.547303 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c0e1d-8cae-4d28-b556-26627cbf46ba None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:52.578211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:52.647774 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c0e1d-8cae-4d28-b556-26627cbf46ba None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:52.682229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c33eb-38a3-4784-a946-d57666cf7718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:52.682844 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c33eb-38a3-4784-a946-d57666cf7718 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:52.683125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c33eb-38a3-4784-a946-d57666cf7718 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:52.683428 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c33eb-38a3-4784-a946-d57666cf7718 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:52.684127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c33eb-38a3-4784-a946-d57666cf7718 None admin] RBAC: Adding query filter params (interface=public, service_id=a9706ed78c324ace9028ddc228071907, region_id=RegionOne) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:52.684437 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c33eb-38a3-4784-a946-d57666cf7718 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:52.685793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c33eb-38a3-4784-a946-d57666cf7718 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:52.691985 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 374/753] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 04:37:52 2022] GET /identity/v3/endpoints?service_id=a9706ed78c324ace9028ddc228071907&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:52.697627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43c24-bbbc-4bce-b980-60a8133c5209 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:52.811485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43c24-bbbc-4bce-b980-60a8133c5209 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:52.843969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:52.850569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6b0b8-452a-433e-bdfd-8c90e810a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:52.851196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6b0b8-452a-433e-bdfd-8c90e810a006 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:52.851558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6b0b8-452a-433e-bdfd-8c90e810a006 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:52.851840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6b0b8-452a-433e-bdfd-8c90e810a006 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:52.852438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6b0b8-452a-433e-bdfd-8c90e810a006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:52.853795 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6b0b8-452a-433e-bdfd-8c90e810a006 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:52.860787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 380/754] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 04:37:52 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:37:53.119089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b4dbe-fde6-4717-a70d-7f787205b004 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:53.119610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b4dbe-fde6-4717-a70d-7f787205b004 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:53.119854 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b4dbe-fde6-4717-a70d-7f787205b004 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:53.121610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 375/755] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:53.127224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837008-e70a-4640-8363-54cc1d66c342 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:53.127699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837008-e70a-4640-8363-54cc1d66c342 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:53.128013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837008-e70a-4640-8363-54cc1d66c342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:53.147434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d9837008-e70a-4640-8363-54cc1d66c342 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:53.148621 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d9837008-e70a-4640-8363-54cc1d66c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:53.225464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 381/756] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:53 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:53.490421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b4dbe-fde6-4717-a70d-7f787205b004 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:53.572565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:53.601240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b4dbe-fde6-4717-a70d-7f787205b004 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:53.636313 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effccfc-46aa-47be-8ae1-9e1c8bd040b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:53.637027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effccfc-46aa-47be-8ae1-9e1c8bd040b3 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:53.637369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effccfc-46aa-47be-8ae1-9e1c8bd040b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:53.637649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effccfc-46aa-47be-8ae1-9e1c8bd040b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:53.638236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effccfc-46aa-47be-8ae1-9e1c8bd040b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:53.639694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effccfc-46aa-47be-8ae1-9e1c8bd040b3 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-8effccfc-46aa-47be-8ae1-9e1c8bd040b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:53.649392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:53.652080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 04:37:53.654086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:53.655853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 376/757] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Oct 12 04:37:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:53.659307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9837008-e70a-4640-8363-54cc1d66c342 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:53.769009 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9837008-e70a-4640-8363-54cc1d66c342 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:53.783964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dc27e-e517-4096-befb-75e0e8f45f1b None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:53.784557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dc27e-e517-4096-befb-75e0e8f45f1b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:53.785043 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dc27e-e517-4096-befb-75e0e8f45f1b None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:53.786847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 377/758] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:53.792030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed4a3-1854-402e-a47f-c836a5c70088 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:53.792313 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed4a3-1854-402e-a47f-c836a5c70088 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:53.792592 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed4a3-1854-402e-a47f-c836a5c70088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:53.795938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:53.808189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35a004-3b58-401a-899f-9451f3d4be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:53.808808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35a004-3b58-401a-899f-9451f3d4be46 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:53.809093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35a004-3b58-401a-899f-9451f3d4be46 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:53.809368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35a004-3b58-401a-899f-9451f3d4be46 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:53.809997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35a004-3b58-401a-899f-9451f3d4be46 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:53.810304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35a004-3b58-401a-899f-9451f3d4be46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:53.811718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35a004-3b58-401a-899f-9451f3d4be46 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:53.821533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 382/759] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:37:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:53.821692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-f86ed4a3-1854-402e-a47f-c836a5c70088 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:53.821692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f86ed4a3-1854-402e-a47f-c836a5c70088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:53.823408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35a004-3b58-401a-899f-9451f3d4be46 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:53.902547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 378/760] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:53 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:53.948067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35a004-3b58-401a-899f-9451f3d4be46 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:53.989427 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bff994-9b43-4fa3-8803-1c5a22090cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:53.990440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bff994-9b43-4fa3-8803-1c5a22090cb4 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:53.990966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bff994-9b43-4fa3-8803-1c5a22090cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:53.991538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bff994-9b43-4fa3-8803-1c5a22090cb4 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:53.992371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bff994-9b43-4fa3-8803-1c5a22090cb4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:53.992872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bff994-9b43-4fa3-8803-1c5a22090cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:53.994547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bff994-9b43-4fa3-8803-1c5a22090cb4 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:54.003722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 383/761] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Oct 12 04:37:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:54.006469 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed4a3-1854-402e-a47f-c836a5c70088 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:54.074720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb3c6-9592-4049-8a3a-f6bb880079b0 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:54.075002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb3c6-9592-4049-8a3a-f6bb880079b0 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:54.075202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb3c6-9592-4049-8a3a-f6bb880079b0 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:54.076826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 384/762] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:54.078759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:54.082263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c6c5e-a52f-4e29-9998-f8a0c270b7ca None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:54.082552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c6c5e-a52f-4e29-9998-f8a0c270b7ca None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:54.082833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c6c5e-a52f-4e29-9998-f8a0c270b7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:54.101333 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-805c6c5e-a52f-4e29-9998-f8a0c270b7ca None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:54.102524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-805c6c5e-a52f-4e29-9998-f8a0c270b7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:54.123134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed4a3-1854-402e-a47f-c836a5c70088 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:54.153459 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:54.172367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93d1e-d22d-4271-809c-994a2a004462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:54.173417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93d1e-d22d-4271-809c-994a2a004462 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:54.174475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93d1e-d22d-4271-809c-994a2a004462 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:54.174951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93d1e-d22d-4271-809c-994a2a004462 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:54.175918 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93d1e-d22d-4271-809c-994a2a004462 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:54.177579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93d1e-d22d-4271-809c-994a2a004462 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:54.179493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 385/763] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:54 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:54.180385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c6c5e-a52f-4e29-9998-f8a0c270b7ca None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:54.211315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 379/764] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:37:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:54.425949 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c6c5e-a52f-4e29-9998-f8a0c270b7ca None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:54.451305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93d1e-d22d-4271-809c-994a2a004462 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:54.470378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940966db-6f8e-4825-8e96-8bd4f054c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:54.471869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940966db-6f8e-4825-8e96-8bd4f054c2bd None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:54.472341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940966db-6f8e-4825-8e96-8bd4f054c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:54.472614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940966db-6f8e-4825-8e96-8bd4f054c2bd None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:54.473247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940966db-6f8e-4825-8e96-8bd4f054c2bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:54.474671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940966db-6f8e-4825-8e96-8bd4f054c2bd None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:54.490721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.sql.core [None req-940966db-6f8e-4825-8e96-8bd4f054c2bd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 04:37:54.490721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 04:37:54.490721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [parameters: {'user_id': '3950166fad3d458eaafaf3b111b0e3a4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 04:37:54.490721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93090) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-940966db-6f8e-4825-8e96-8bd4f054c2bd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application conn.query(q) Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result.read() Oct 12 04:37:54.497763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 04:37:54.498693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application next(self.gen) Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application yield resource Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application next(self.gen) Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise self.value Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application session.commit() Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 04:37:54.500080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.session.flush() Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application compat.raise_( Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 04:37:54.501219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 04:37:54.502842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application conn.query(q) Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result.read() Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 04:37:54.503720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [parameters: {'user_id': '3950166fad3d458eaafaf3b111b0e3a4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:54.505762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 12 04:37:54.507810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 12 04:37:54.509922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 12 04:37:54.509922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 12 04:37:54.509922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 04:37:54.509922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 04:37:54.509922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 04:37:54.509922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:54.509922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 386/765] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Oct 12 04:37:54 2022] POST /identity/v3/users => generated 160 bytes in 319 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:54.509922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940966db-6f8e-4825-8e96-8bd4f054c2bd None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:54.563660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:54.619683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93d1e-d22d-4271-809c-994a2a004462 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:54.631660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940966db-6f8e-4825-8e96-8bd4f054c2bd None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:54.655205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:54.667973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae6820-a57d-4491-b83e-fd8c96b33332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:54.669038 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6820-a57d-4491-b83e-fd8c96b33332 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:54.669467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6820-a57d-4491-b83e-fd8c96b33332 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:54.669885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6820-a57d-4491-b83e-fd8c96b33332 None admin] PATH_INFO: `/v3/services/image` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:54.670117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db53c-d873-4c5a-b85d-7b3276093c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:54.670816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae6820-a57d-4491-b83e-fd8c96b33332 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:54.670969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db53c-d873-4c5a-b85d-7b3276093c71 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:54.671412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db53c-d873-4c5a-b85d-7b3276093c71 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:54.671784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db53c-d873-4c5a-b85d-7b3276093c71 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:54.672795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae6820-a57d-4491-b83e-fd8c96b33332 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:54.680591 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db53c-d873-4c5a-b85d-7b3276093c71 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:54.682276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db53c-d873-4c5a-b85d-7b3276093c71 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-f7ae6820-a57d-4491-b83e-fd8c96b33332 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:54.684291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:54.685457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 04:37:54.686487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:54.688498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 380/766] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Oct 12 04:37:54 2022] GET /identity/v3/services/image => generated 86 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:54.694736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae6820-a57d-4491-b83e-fd8c96b33332 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-3d1db53c-d873-4c5a-b85d-7b3276093c71 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:54.700479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:54.701421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:54.702760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:54.702760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:54.702760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:54.702760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:54.702760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:54.702760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:54.702760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:54.702760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:54.702760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 04:37:54.702760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:54.707053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 387/767] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:37:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:37:54.708257 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db53c-d873-4c5a-b85d-7b3276093c71 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:54.817849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae6820-a57d-4491-b83e-fd8c96b33332 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:54.823047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:54.827116 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db53c-d873-4c5a-b85d-7b3276093c71 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:54.857155 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe9c01-c609-410e-8c45-5384e780a488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:54.858120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe9c01-c609-410e-8c45-5384e780a488 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:54.858619 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe9c01-c609-410e-8c45-5384e780a488 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:54.859215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe9c01-c609-410e-8c45-5384e780a488 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:54.860246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe9c01-c609-410e-8c45-5384e780a488 None admin] RBAC: Adding query filter params (name=image) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:54.861041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe9c01-c609-410e-8c45-5384e780a488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:54.863439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe9c01-c609-410e-8c45-5384e780a488 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:54.873547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 381/768] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:54.874370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa8c73-eea8-46dd-887b-77d064a4f134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:54.874915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8c73-eea8-46dd-887b-77d064a4f134 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:54.875205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8c73-eea8-46dd-887b-77d064a4f134 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:54.875515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8c73-eea8-46dd-887b-77d064a4f134 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:54.876214 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa8c73-eea8-46dd-887b-77d064a4f134 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:54.876523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa8c73-eea8-46dd-887b-77d064a4f134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:54.878015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa8c73-eea8-46dd-887b-77d064a4f134 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:54.880230 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe9c01-c609-410e-8c45-5384e780a488 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:54.923171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 388/769] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Oct 12 04:37:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:55.000565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe9c01-c609-410e-8c45-5384e780a488 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:55.003926 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:55.040052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f648d-b790-44a0-80f3-f7f1e9f983bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:55.040682 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f648d-b790-44a0-80f3-f7f1e9f983bc None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:55.040969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f648d-b790-44a0-80f3-f7f1e9f983bc None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:55.041246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f648d-b790-44a0-80f3-f7f1e9f983bc None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:55.041894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f648d-b790-44a0-80f3-f7f1e9f983bc None admin] RBAC: Adding query filter params (type=image) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:55.042203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f648d-b790-44a0-80f3-f7f1e9f983bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:55.043654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f648d-b790-44a0-80f3-f7f1e9f983bc None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:55.048638 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e56242-98ce-4648-ac94-ba54c91202c4 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:55.049025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e56242-98ce-4648-ac94-ba54c91202c4 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:55.049248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e56242-98ce-4648-ac94-ba54c91202c4 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:55.050467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 382/770] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:55.050603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 389/771] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:55.056445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2345126-322e-468d-b8ec-2000a939edf3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:55.056751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2345126-322e-468d-b8ec-2000a939edf3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:55.056999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2345126-322e-468d-b8ec-2000a939edf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:55.057662 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e56242-98ce-4648-ac94-ba54c91202c4 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:55.077062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-d2345126-322e-468d-b8ec-2000a939edf3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:55.078284 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d2345126-322e-468d-b8ec-2000a939edf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:55.159046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 383/772] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:55 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:55.185546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e56242-98ce-4648-ac94-ba54c91202c4 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:55.224782 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6c6c-7d86-459b-9f73-1b66cb7973f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:55.225402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6c6c-7d86-459b-9f73-1b66cb7973f2 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:55.225779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6c6c-7d86-459b-9f73-1b66cb7973f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:55.226036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6c6c-7d86-459b-9f73-1b66cb7973f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:55.226848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f6c6c-7d86-459b-9f73-1b66cb7973f2 None admin] RBAC: Adding query filter params (interface=public, service_id=1a2045844a0447b598ad74dd3fefe960, region_id=RegionOne) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:55.227199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f6c6c-7d86-459b-9f73-1b66cb7973f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:55.228861 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f6c6c-7d86-459b-9f73-1b66cb7973f2 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:55.238280 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 390/773] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 04:37:55 2022] GET /identity/v3/endpoints?service_id=1a2045844a0447b598ad74dd3fefe960&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:55.244569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2345126-322e-468d-b8ec-2000a939edf3 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:55.297297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:55.348233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2345126-322e-468d-b8ec-2000a939edf3 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:55.382129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceb70f-9b5d-462a-a289-825769b42142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:55.382736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceb70f-9b5d-462a-a289-825769b42142 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:55.383020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceb70f-9b5d-462a-a289-825769b42142 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:55.383317 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceb70f-9b5d-462a-a289-825769b42142 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:55.383925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceb70f-9b5d-462a-a289-825769b42142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:55.385284 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceb70f-9b5d-462a-a289-825769b42142 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:55.391594 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 384/774] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 04:37:55 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:37:55.426694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6c6c-7d86-459b-9f73-1b66cb7973f2 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:55.454647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:55.537569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f6c6c-7d86-459b-9f73-1b66cb7973f2 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:55.583051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb385069-0aff-48dc-a7a7-02506abddfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:55.583722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385069-0aff-48dc-a7a7-02506abddfd9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:55.584006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385069-0aff-48dc-a7a7-02506abddfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:55.584284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385069-0aff-48dc-a7a7-02506abddfd9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:55.585018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb385069-0aff-48dc-a7a7-02506abddfd9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:55.586384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb385069-0aff-48dc-a7a7-02506abddfd9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-cb385069-0aff-48dc-a7a7-02506abddfd9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:55.596278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:55.597273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 04:37:55.598152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:55.602396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 391/775] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:37:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:55.603790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceb70f-9b5d-462a-a289-825769b42142 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:55.704109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceb70f-9b5d-462a-a289-825769b42142 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:55.719173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:55.740357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142babd-5c21-4214-b0f4-2e4dd7dd221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:55.740974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142babd-5c21-4214-b0f4-2e4dd7dd221d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:55.741265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142babd-5c21-4214-b0f4-2e4dd7dd221d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:55.741530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142babd-5c21-4214-b0f4-2e4dd7dd221d None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:55.742150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142babd-5c21-4214-b0f4-2e4dd7dd221d None admin] RBAC: Adding query filter params (name=compute) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:55.742454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142babd-5c21-4214-b0f4-2e4dd7dd221d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:55.743909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142babd-5c21-4214-b0f4-2e4dd7dd221d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:55.753795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 385/776] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:55.755336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb385069-0aff-48dc-a7a7-02506abddfd9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:55.842469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:55.857864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb385069-0aff-48dc-a7a7-02506abddfd9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:55.896886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad46a5-7ea5-458b-a1b7-fc320254e540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:55.897501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad46a5-7ea5-458b-a1b7-fc320254e540 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:55.897788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad46a5-7ea5-458b-a1b7-fc320254e540 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:55.898067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad46a5-7ea5-458b-a1b7-fc320254e540 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:55.898692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad46a5-7ea5-458b-a1b7-fc320254e540 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:55.899034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad46a5-7ea5-458b-a1b7-fc320254e540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:55.900424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad46a5-7ea5-458b-a1b7-fc320254e540 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:55.905323 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 392/777] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Oct 12 04:37:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:55.911612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142babd-5c21-4214-b0f4-2e4dd7dd221d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:56.009401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142babd-5c21-4214-b0f4-2e4dd7dd221d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:56.043215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731294e-e6ee-43dc-8053-f71e7a9433e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:56.043842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731294e-e6ee-43dc-8053-f71e7a9433e4 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:56.044119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731294e-e6ee-43dc-8053-f71e7a9433e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:56.044386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731294e-e6ee-43dc-8053-f71e7a9433e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:56.045057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731294e-e6ee-43dc-8053-f71e7a9433e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:56.046403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731294e-e6ee-43dc-8053-f71e7a9433e4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:56.067386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 386/778] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:37:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:37:56.508676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4581a-352f-401a-bd52-9b6c72723498 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:56.509196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4581a-352f-401a-bd52-9b6c72723498 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:56.509272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4581a-352f-401a-bd52-9b6c72723498 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:56.510605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 393/779] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:56.515836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0485e-505a-4307-ada7-88744d9e92d4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:56.516216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0485e-505a-4307-ada7-88744d9e92d4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:56.516398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0485e-505a-4307-ada7-88744d9e92d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:56.534740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-39c0485e-505a-4307-ada7-88744d9e92d4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:56.535962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-39c0485e-505a-4307-ada7-88744d9e92d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:56.566064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:56.618946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 387/780] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:56.885399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4581a-352f-401a-bd52-9b6c72723498 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:56.987993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4581a-352f-401a-bd52-9b6c72723498 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:57.022698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eba59-de0f-4c8f-acbd-94b8a495024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:57.023381 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eba59-de0f-4c8f-acbd-94b8a495024f None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:57.023667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eba59-de0f-4c8f-acbd-94b8a495024f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:57.023948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eba59-de0f-4c8f-acbd-94b8a495024f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:57.025143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2eba59-de0f-4c8f-acbd-94b8a495024f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:57.026601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2eba59-de0f-4c8f-acbd-94b8a495024f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:57.028476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 394/781] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:57.034047 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0485e-505a-4307-ada7-88744d9e92d4 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:57.134412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0485e-505a-4307-ada7-88744d9e92d4 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:57.168263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9500dfb-6360-4985-a187-d1f1a7ef0f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:57.168808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500dfb-6360-4985-a187-d1f1a7ef0f37 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:57.169094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500dfb-6360-4985-a187-d1f1a7ef0f37 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:57.169370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500dfb-6360-4985-a187-d1f1a7ef0f37 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:57.170030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9500dfb-6360-4985-a187-d1f1a7ef0f37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:57.171472 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9500dfb-6360-4985-a187-d1f1a7ef0f37 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:57.200071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 388/782] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:37:57 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:57.577399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cefa8a-6637-488b-bb99-aaf8b1f3b90e None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:57.577933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cefa8a-6637-488b-bb99-aaf8b1f3b90e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:57.577933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cefa8a-6637-488b-bb99-aaf8b1f3b90e None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:57.579778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 395/783] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:57.585348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0748-535a-426e-b79e-76c677ae6c69 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:57.585725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0748-535a-426e-b79e-76c677ae6c69 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:57.585897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0748-535a-426e-b79e-76c677ae6c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:57.605348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-242e0748-535a-426e-b79e-76c677ae6c69 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:57.606538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-242e0748-535a-426e-b79e-76c677ae6c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:57.614533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:57.675823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 389/784] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:37:57.943730 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cefa8a-6637-488b-bb99-aaf8b1f3b90e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:57.963159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:58.048300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cefa8a-6637-488b-bb99-aaf8b1f3b90e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:58.082106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288259c-b972-4caf-a815-ee19f7a33171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:58.082735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288259c-b972-4caf-a815-ee19f7a33171 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:58.083016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288259c-b972-4caf-a815-ee19f7a33171 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:58.083308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288259c-b972-4caf-a815-ee19f7a33171 None admin] PATH_INFO: `/v3/services/image` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:58.083883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288259c-b972-4caf-a815-ee19f7a33171 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:58.085229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288259c-b972-4caf-a815-ee19f7a33171 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-a288259c-b972-4caf-a815-ee19f7a33171 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:58.094151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:58.095174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 04:37:58.096158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:37:58.099692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 396/785] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Oct 12 04:37:57 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:58.101542 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e0748-535a-426e-b79e-76c677ae6c69 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:58.202741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e0748-535a-426e-b79e-76c677ae6c69 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:58.239558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fac32-2aa3-4968-9e5f-2c1864be6e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:58.240174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fac32-2aa3-4968-9e5f-2c1864be6e1b None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:58.240457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fac32-2aa3-4968-9e5f-2c1864be6e1b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:58.240735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fac32-2aa3-4968-9e5f-2c1864be6e1b None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:58.241359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fac32-2aa3-4968-9e5f-2c1864be6e1b None admin] RBAC: Adding query filter params (name=image) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:58.241666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fac32-2aa3-4968-9e5f-2c1864be6e1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:58.243026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fac32-2aa3-4968-9e5f-2c1864be6e1b None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:58.247992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 390/786] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:58.254128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288259c-b972-4caf-a815-ee19f7a33171 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:58.308581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1867e-19de-4d2a-9dcc-bc683d68eafb None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:58.308914 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1867e-19de-4d2a-9dcc-bc683d68eafb None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:58.309146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1867e-19de-4d2a-9dcc-bc683d68eafb None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:58.310624 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 391/787] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:37:58.316724 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a1295-afa3-40f9-8bdd-58027c5f882c None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:58.317015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a1295-afa3-40f9-8bdd-58027c5f882c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:58.317293 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a1295-afa3-40f9-8bdd-58027c5f882c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:58.330191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:58.338141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-345a1295-afa3-40f9-8bdd-58027c5f882c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:58.338966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:58.340010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-345a1295-afa3-40f9-8bdd-58027c5f882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:58.360680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288259c-b972-4caf-a815-ee19f7a33171 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:58.395819 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b72d-c541-472c-ac02-8d317b6ec689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:58.396421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b72d-c541-472c-ac02-8d317b6ec689 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:58.396702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b72d-c541-472c-ac02-8d317b6ec689 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:58.396980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b72d-c541-472c-ac02-8d317b6ec689 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:58.397596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b72d-c541-472c-ac02-8d317b6ec689 None admin] RBAC: Adding query filter params (type=image) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:58.397901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b72d-c541-472c-ac02-8d317b6ec689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:58.399255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b72d-c541-472c-ac02-8d317b6ec689 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:58.408770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 397/788] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:58.409745 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b72d-c541-472c-ac02-8d317b6ec689 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:58.418869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 392/789] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:58.511996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b72d-c541-472c-ac02-8d317b6ec689 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:58.546292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f1f63-1fd1-4aff-a2e6-27a474f448dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:58.546899 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1f63-1fd1-4aff-a2e6-27a474f448dc None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:58.547181 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1f63-1fd1-4aff-a2e6-27a474f448dc None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:58.547503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1f63-1fd1-4aff-a2e6-27a474f448dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:58.548128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f1f63-1fd1-4aff-a2e6-27a474f448dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:58.549515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f1f63-1fd1-4aff-a2e6-27a474f448dc None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:58.579479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 398/790] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:37:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:37:58.696798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a1295-afa3-40f9-8bdd-58027c5f882c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:58.804685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a1295-afa3-40f9-8bdd-58027c5f882c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:58.843376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:58.849441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020311f8-46dc-4939-90e8-25171872cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:58.850081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020311f8-46dc-4939-90e8-25171872cef9 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:58.850364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020311f8-46dc-4939-90e8-25171872cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:58.850640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020311f8-46dc-4939-90e8-25171872cef9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:58.861668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020311f8-46dc-4939-90e8-25171872cef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-020311f8-46dc-4939-90e8-25171872cef9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:37:58.866470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:58.867653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:58.868546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 393/791] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 04:37:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:58.875229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f1f63-1fd1-4aff-a2e6-27a474f448dc None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:58.878111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:58.977664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f1f63-1fd1-4aff-a2e6-27a474f448dc None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:59.010984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f791f2-8716-4427-978e-f51359316560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:59.011629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f791f2-8716-4427-978e-f51359316560 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:59.011915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f791f2-8716-4427-978e-f51359316560 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:59.012189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f791f2-8716-4427-978e-f51359316560 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:59.012849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f791f2-8716-4427-978e-f51359316560 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:59.013154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f791f2-8716-4427-978e-f51359316560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:59.014518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f791f2-8716-4427-978e-f51359316560 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:59.023557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 399/792] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Oct 12 04:37:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:59.029135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020311f8-46dc-4939-90e8-25171872cef9 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:59.129286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020311f8-46dc-4939-90e8-25171872cef9 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:59.163058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7167b0-d85a-4262-86ae-3b6948887ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:59.163702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7167b0-d85a-4262-86ae-3b6948887ad6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:59.163979 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7167b0-d85a-4262-86ae-3b6948887ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:59.164248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7167b0-d85a-4262-86ae-3b6948887ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:59.173983 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7167b0-d85a-4262-86ae-3b6948887ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:59.175433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7167b0-d85a-4262-86ae-3b6948887ad6 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-ed7167b0-d85a-4262-86ae-3b6948887ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:59.189561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:59.190718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:59.191656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:59.191656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:59.191656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:59.191656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 394/793] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:59.196504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f791f2-8716-4427-978e-f51359316560 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:59.261419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:59.303827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f791f2-8716-4427-978e-f51359316560 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:59.338536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7df2-f3f4-46cb-8e10-b0e9ceb15e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:59.339414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7df2-f3f4-46cb-8e10-b0e9ceb15e02 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:59.339715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7df2-f3f4-46cb-8e10-b0e9ceb15e02 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:59.339995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7df2-f3f4-46cb-8e10-b0e9ceb15e02 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:59.340663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7df2-f3f4-46cb-8e10-b0e9ceb15e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:59.340969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7df2-f3f4-46cb-8e10-b0e9ceb15e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:59.342339 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7df2-f3f4-46cb-8e10-b0e9ceb15e02 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:59.354511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 400/794] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:59.360082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7167b0-d85a-4262-86ae-3b6948887ad6 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:59.378944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e313-eb5a-49f0-b52c-a05d79de11c1 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:59.379238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e313-eb5a-49f0-b52c-a05d79de11c1 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:59.379603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e313-eb5a-49f0-b52c-a05d79de11c1 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:59.380995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 401/795] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:37:59.385797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99111-0145-4ccf-8e40-f26b1575f7b0 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:59.386082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99111-0145-4ccf-8e40-f26b1575f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:59.386362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99111-0145-4ccf-8e40-f26b1575f7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:59.405614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-42f99111-0145-4ccf-8e40-f26b1575f7b0 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:37:59.407512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-42f99111-0145-4ccf-8e40-f26b1575f7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:37:59.412375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:59.473874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7167b0-d85a-4262-86ae-3b6948887ad6 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:59.479802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 402/796] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:37:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:37:59.510352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b03a-ccea-4511-8de9-e51eb3472bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:59.511082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b03a-ccea-4511-8de9-e51eb3472bec None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:59.511490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b03a-ccea-4511-8de9-e51eb3472bec None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:59.511841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b03a-ccea-4511-8de9-e51eb3472bec None admin] PATH_INFO: `/v3/users/nova` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:59.519703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95b03a-ccea-4511-8de9-e51eb3472bec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:59.521141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95b03a-ccea-4511-8de9-e51eb3472bec None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-ad95b03a-ccea-4511-8de9-e51eb3472bec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:37:59.532257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:59.533720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:59.539737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 395/797] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 04:37:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:59.541516 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f99111-0145-4ccf-8e40-f26b1575f7b0 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:59.613011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:59.659042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f99111-0145-4ccf-8e40-f26b1575f7b0 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:59.693129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b65e05-c7ac-455e-9885-0032eea015a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:59.693735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b65e05-c7ac-455e-9885-0032eea015a4 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:59.694015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b65e05-c7ac-455e-9885-0032eea015a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:59.694286 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b65e05-c7ac-455e-9885-0032eea015a4 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:59.695065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b65e05-c7ac-455e-9885-0032eea015a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:37:59.695405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b65e05-c7ac-455e-9885-0032eea015a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:59.696812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b65e05-c7ac-455e-9885-0032eea015a4 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:59.713978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 403/798] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 04:37:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:37:59.719919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b03a-ccea-4511-8de9-e51eb3472bec None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:59.749888 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b65e05-c7ac-455e-9885-0032eea015a4 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:59.826851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b03a-ccea-4511-8de9-e51eb3472bec None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:59.829630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:59.862221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b65e05-c7ac-455e-9885-0032eea015a4 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:37:59.864238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed19d1-6276-438e-af57-ddf160b6f0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:59.864871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed19d1-6276-438e-af57-ddf160b6f0c6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:59.865152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed19d1-6276-438e-af57-ddf160b6f0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:59.865430 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed19d1-6276-438e-af57-ddf160b6f0c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:59.875982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed19d1-6276-438e-af57-ddf160b6f0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:59.877595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:37:59.877827 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed19d1-6276-438e-af57-ddf160b6f0c6 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-b7ed19d1-6276-438e-af57-ddf160b6f0c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:37:59.895332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:37:59.896548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:37:59.897704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:37:59.897704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:37:59.897704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:37:59.901217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 396/799] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:37:59.902061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed19d1-6276-438e-af57-ddf160b6f0c6 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:37:59.904409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce8ee2-4d2c-44eb-b53f-2a7458bc9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:37:59.905298 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce8ee2-4d2c-44eb-b53f-2a7458bc9404 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:37:59.906464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce8ee2-4d2c-44eb-b53f-2a7458bc9404 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:37:59.906811 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce8ee2-4d2c-44eb-b53f-2a7458bc9404 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:37:59.908192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce8ee2-4d2c-44eb-b53f-2a7458bc9404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:37:59.909683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce8ee2-4d2c-44eb-b53f-2a7458bc9404 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:37:59.916288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 404/800] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:37:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:37:59.917123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce8ee2-4d2c-44eb-b53f-2a7458bc9404 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:00.005958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed19d1-6276-438e-af57-ddf160b6f0c6 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:00.023610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce8ee2-4d2c-44eb-b53f-2a7458bc9404 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:00.040702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6853-7315-4823-a506-fa4f62b5e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:00.041305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6853-7315-4823-a506-fa4f62b5e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:00.041585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6853-7315-4823-a506-fa4f62b5e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:00.041856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6853-7315-4823-a506-fa4f62b5e2a1 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:00.042489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a6853-7315-4823-a506-fa4f62b5e2a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:00.042796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a6853-7315-4823-a506-fa4f62b5e2a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:00.044243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a6853-7315-4823-a506-fa4f62b5e2a1 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:00.056953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 397/801] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:00.057231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d859-b010-4799-ace4-e81f9520bf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:00.057831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d859-b010-4799-ace4-e81f9520bf24 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:00.058115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d859-b010-4799-ace4-e81f9520bf24 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:00.058390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d859-b010-4799-ace4-e81f9520bf24 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:00.059020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6d859-b010-4799-ace4-e81f9520bf24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:00.060466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6d859-b010-4799-ace4-e81f9520bf24 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:00.062328 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6853-7315-4823-a506-fa4f62b5e2a1 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:00.082285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:00.091698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 405/802] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:37:59 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:38:00.174172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6853-7315-4823-a506-fa4f62b5e2a1 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:00.210095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1397faa-a640-43dc-8f4f-916a9e58e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:00.210747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1397faa-a640-43dc-8f4f-916a9e58e36a None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:00.211026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1397faa-a640-43dc-8f4f-916a9e58e36a None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:00.211305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1397faa-a640-43dc-8f4f-916a9e58e36a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:00.218991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1397faa-a640-43dc-8f4f-916a9e58e36a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:00.221033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1397faa-a640-43dc-8f4f-916a9e58e36a None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-c1397faa-a640-43dc-8f4f-916a9e58e36a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:38:00.233644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:00.234630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:00.235598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:38:00.235598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:38:00.235598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:38:00.235598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:38:00.235598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:38:00.235598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:38:00.235598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:38:00.235598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:38:00.235598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 398/803] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:38:00.240762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d859-b010-4799-ace4-e81f9520bf24 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:00.278529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:00.346828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d859-b010-4799-ace4-e81f9520bf24 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:00.381421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0183ddc-5dae-4ebb-aa77-f6082bfc0db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:00.382018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0183ddc-5dae-4ebb-aa77-f6082bfc0db1 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:00.382296 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0183ddc-5dae-4ebb-aa77-f6082bfc0db1 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:00.382567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0183ddc-5dae-4ebb-aa77-f6082bfc0db1 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:00.383248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0183ddc-5dae-4ebb-aa77-f6082bfc0db1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:00.383589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0183ddc-5dae-4ebb-aa77-f6082bfc0db1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:00.385007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0183ddc-5dae-4ebb-aa77-f6082bfc0db1 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:00.402146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 406/804] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:38:00.403310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1397faa-a640-43dc-8f4f-916a9e58e36a None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:00.480059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:00.506096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1397faa-a640-43dc-8f4f-916a9e58e36a None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:00.542173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b215a-1cdd-4c3a-9427-7caa25775e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:00.542822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b215a-1cdd-4c3a-9427-7caa25775e58 None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:00.543148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b215a-1cdd-4c3a-9427-7caa25775e58 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:00.543457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b215a-1cdd-4c3a-9427-7caa25775e58 None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/7e02bef3699b4569986b36cec686931a/roles/cea949ae420a46e18943f9f02af359b7` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:00.545545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b215a-1cdd-4c3a-9427-7caa25775e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=7e02bef3699b4569986b36cec686931a, role_id=cea949ae420a46e18943f9f02af359b7)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:00.546957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b215a-1cdd-4c3a-9427-7caa25775e58 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:00.571310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 399/805] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:38:00 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/7e02bef3699b4569986b36cec686931a/roles/cea949ae420a46e18943f9f02af359b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:38:00.784063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a744b4a-58f6-4fe4-b3ec-2e4578bbc010 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:00.784566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a744b4a-58f6-4fe4-b3ec-2e4578bbc010 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:00.784566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a744b4a-58f6-4fe4-b3ec-2e4578bbc010 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:00.785992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 407/806] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:00.791165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657f7c9-5aee-48c3-8efd-d9061f843b7d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:00.791588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657f7c9-5aee-48c3-8efd-d9061f843b7d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:00.791746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657f7c9-5aee-48c3-8efd-d9061f843b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:00.809781 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-8657f7c9-5aee-48c3-8efd-d9061f843b7d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:00.810959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8657f7c9-5aee-48c3-8efd-d9061f843b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:00.878210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 400/807] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:01.148569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a744b4a-58f6-4fe4-b3ec-2e4578bbc010 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:01.243512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:01.251360 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a744b4a-58f6-4fe4-b3ec-2e4578bbc010 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:01.284749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e574b53-4f87-459e-babd-1086ba1ad378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:01.285355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e574b53-4f87-459e-babd-1086ba1ad378 None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:01.285630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e574b53-4f87-459e-babd-1086ba1ad378 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:01.285897 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e574b53-4f87-459e-babd-1086ba1ad378 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:01.286563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e574b53-4f87-459e-babd-1086ba1ad378 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:01.287932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e574b53-4f87-459e-babd-1086ba1ad378 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:01.295480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.sql.core [None req-1e574b53-4f87-459e-babd-1086ba1ad378 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 04:38:01.295480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 04:38:01.295480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [parameters: {'id': '91a2d3d3328a4b60a83a2b6e999b7cc9', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 04:38:01.295480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93090) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-1e574b53-4f87-459e-babd-1086ba1ad378 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application conn.query(q) Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 04:38:01.303076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result.read() Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 04:38:01.303950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application next(self.gen) Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application yield resource Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application next(self.gen) Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise self.value Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application session.commit() Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 04:38:01.304956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.session.flush() Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application compat.raise_( Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 04:38:01.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 04:38:01.306779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application conn.query(q) Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application result.read() Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 04:38:01.307597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [parameters: {'id': '91a2d3d3328a4b60a83a2b6e999b7cc9', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 04:38:01.308483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:01.309302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:01.310230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 408/808] 10.222.0.18 () {60 vars in 1137 bytes} [Wed Oct 12 04:38:01 2022] POST /identity/v3/domains => generated 190 bytes in 157 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:38:01.310952 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657f7c9-5aee-48c3-8efd-d9061f843b7d None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:01.375894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:01.411830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657f7c9-5aee-48c3-8efd-d9061f843b7d None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:01.447814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f649c5f-57ae-4edc-a90f-045bce0404d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:01.448642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f649c5f-57ae-4edc-a90f-045bce0404d6 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:01.448921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f649c5f-57ae-4edc-a90f-045bce0404d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:01.449188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f649c5f-57ae-4edc-a90f-045bce0404d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:01.459366 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f649c5f-57ae-4edc-a90f-045bce0404d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:01.460797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f649c5f-57ae-4edc-a90f-045bce0404d6 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-4f649c5f-57ae-4edc-a90f-045bce0404d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:38:01.475105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:01.476123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:38:01.477031 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:38:01.477031 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:38:01.477031 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:38:01.479364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 401/809] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:38:01.482430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e574b53-4f87-459e-babd-1086ba1ad378 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:01.586750 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e574b53-4f87-459e-babd-1086ba1ad378 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:01.619822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6316d-8da9-4898-8cc8-c1194cf8f9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:01.620421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6316d-8da9-4898-8cc8-c1194cf8f9e9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:01.620699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6316d-8da9-4898-8cc8-c1194cf8f9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:01.620966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6316d-8da9-4898-8cc8-c1194cf8f9e9 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:01.621586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6316d-8da9-4898-8cc8-c1194cf8f9e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:01.621886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6316d-8da9-4898-8cc8-c1194cf8f9e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:01.623239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6316d-8da9-4898-8cc8-c1194cf8f9e9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:01.634300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 409/810] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:38:02.287616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3135782-32a7-45e0-99aa-3f811902736b None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:02.288178 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3135782-32a7-45e0-99aa-3f811902736b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:02.288178 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3135782-32a7-45e0-99aa-3f811902736b None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:02.289484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 402/811] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:02.294720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfe849-6e82-404b-9851-f978826a41b7 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:02.295122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfe849-6e82-404b-9851-f978826a41b7 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:02.295274 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfe849-6e82-404b-9851-f978826a41b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:02.312912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-abbfe849-6e82-404b-9851-f978826a41b7 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:02.314084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-abbfe849-6e82-404b-9851-f978826a41b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:02.327778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:02.381660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 410/812] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:38:02.648793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3135782-32a7-45e0-99aa-3f811902736b None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:02.711303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a90c4-004d-4720-8ee7-2f21e60d5e20 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:02.711595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a90c4-004d-4720-8ee7-2f21e60d5e20 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:02.711907 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a90c4-004d-4720-8ee7-2f21e60d5e20 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:02.713258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 411/813] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:38:02.718373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6949176-12ea-4caf-a2ad-5db3ca1f835f None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:02.718659 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6949176-12ea-4caf-a2ad-5db3ca1f835f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:02.718944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6949176-12ea-4caf-a2ad-5db3ca1f835f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:02.736620 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c6949176-12ea-4caf-a2ad-5db3ca1f835f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:02.737789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c6949176-12ea-4caf-a2ad-5db3ca1f835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:02.748454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3135782-32a7-45e0-99aa-3f811902736b None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:02.766501 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:02.785350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa383c2-3fde-4f0e-a1f2-921bf36b332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:02.785976 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa383c2-3fde-4f0e-a1f2-921bf36b332f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:02.786260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa383c2-3fde-4f0e-a1f2-921bf36b332f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:02.786535 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa383c2-3fde-4f0e-a1f2-921bf36b332f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:02.796406 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa383c2-3fde-4f0e-a1f2-921bf36b332f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-1fa383c2-3fde-4f0e-a1f2-921bf36b332f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:38:02.801677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:02.802884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:38:02.804290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 403/814] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:38:02.805119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 412/815] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:38:02.808682 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa383c2-3fde-4f0e-a1f2-921bf36b332f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:02.905352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa383c2-3fde-4f0e-a1f2-921bf36b332f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:02.937959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec303-f2ec-4c53-a3de-c9d2d293af3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:02.938548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec303-f2ec-4c53-a3de-c9d2d293af3e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:02.938831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec303-f2ec-4c53-a3de-c9d2d293af3e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:02.939108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec303-f2ec-4c53-a3de-c9d2d293af3e None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:02.939826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ec303-f2ec-4c53-a3de-c9d2d293af3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:02.940137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ec303-f2ec-4c53-a3de-c9d2d293af3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:02.941507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ec303-f2ec-4c53-a3de-c9d2d293af3e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:02.949256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 404/816] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:02.955484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6949176-12ea-4caf-a2ad-5db3ca1f835f None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:03.031243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:03.050787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6949176-12ea-4caf-a2ad-5db3ca1f835f None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:03.069790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec303-f2ec-4c53-a3de-c9d2d293af3e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:03.085375 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904c5a-c882-487b-9c47-84d1e683f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:03.086038 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904c5a-c882-487b-9c47-84d1e683f064 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:03.086326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904c5a-c882-487b-9c47-84d1e683f064 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:03.086603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904c5a-c882-487b-9c47-84d1e683f064 None admin] PATH_INFO: `/v3/users/82609856f83e4e8ba942dc728056454a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:03.099876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d904c5a-c882-487b-9c47-84d1e683f064 None admin] RBAC: Authorizing `identity:get_user(user_id=82609856f83e4e8ba942dc728056454a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:03.101346 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d904c5a-c882-487b-9c47-84d1e683f064 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:03.102944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 413/817] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:38:02 2022] GET /identity/v3/users/82609856f83e4e8ba942dc728056454a => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:03.108581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904c5a-c882-487b-9c47-84d1e683f064 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:03.110644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:03.168057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec303-f2ec-4c53-a3de-c9d2d293af3e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:03.201902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726fad7-5e1a-4ba0-b391-81eddfc855f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:03.202529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726fad7-5e1a-4ba0-b391-81eddfc855f7 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:03.202801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726fad7-5e1a-4ba0-b391-81eddfc855f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:03.203078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726fad7-5e1a-4ba0-b391-81eddfc855f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:03.206590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904c5a-c882-487b-9c47-84d1e683f064 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:03.213456 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726fad7-5e1a-4ba0-b391-81eddfc855f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-9726fad7-5e1a-4ba0-b391-81eddfc855f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:38:03.218465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:03.219572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:38:03.220959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 405/818] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Oct 12 04:38:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:38:03.226152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726fad7-5e1a-4ba0-b391-81eddfc855f7 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:03.242783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4304e0-047d-46bc-8728-9ee2103065b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:03.243441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4304e0-047d-46bc-8728-9ee2103065b7 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:03.243720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4304e0-047d-46bc-8728-9ee2103065b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:03.243994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4304e0-047d-46bc-8728-9ee2103065b7 None admin] PATH_INFO: `/v3/projects/9191540691534f44bea585f95a7db9f7` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:03.245353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4304e0-047d-46bc-8728-9ee2103065b7 None admin] RBAC: Authorizing `identity:get_project(project_id=9191540691534f44bea585f95a7db9f7)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:03.246800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4304e0-047d-46bc-8728-9ee2103065b7 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:03.248447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 414/819] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:38:03 2022] GET /identity/v3/projects/9191540691534f44bea585f95a7db9f7 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:38:03.255068 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4304e0-047d-46bc-8728-9ee2103065b7 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:03.263140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:03.322453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:03.325510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726fad7-5e1a-4ba0-b391-81eddfc855f7 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:03.352840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4304e0-047d-46bc-8728-9ee2103065b7 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:03.358859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217cb62-d180-4349-965a-7580f903a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:03.359494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217cb62-d180-4349-965a-7580f903a1b7 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:03.359776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217cb62-d180-4349-965a-7580f903a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:03.360048 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217cb62-d180-4349-965a-7580f903a1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:03.360696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217cb62-d180-4349-965a-7580f903a1b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:03.361541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217cb62-d180-4349-965a-7580f903a1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:03.362906 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217cb62-d180-4349-965a-7580f903a1b7 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:03.370893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 406/820] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Oct 12 04:38:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:38:03.376703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217cb62-d180-4349-965a-7580f903a1b7 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:03.387076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57566111-620e-46c9-9e22-d7232702c137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:03.387776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57566111-620e-46c9-9e22-d7232702c137 None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:03.388061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57566111-620e-46c9-9e22-d7232702c137 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:03.388620 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57566111-620e-46c9-9e22-d7232702c137 None admin] PATH_INFO: `/v3/projects/9191540691534f44bea585f95a7db9f7/users/82609856f83e4e8ba942dc728056454a/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:03.390273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57566111-620e-46c9-9e22-d7232702c137 None admin] RBAC: Authorizing `identity:create_grant(project_id=9191540691534f44bea585f95a7db9f7, user_id=82609856f83e4e8ba942dc728056454a, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:03.391771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57566111-620e-46c9-9e22-d7232702c137 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:03.405133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 415/821] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:38:03 2022] PUT /identity/v3/projects/9191540691534f44bea585f95a7db9f7/users/82609856f83e4e8ba942dc728056454a/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:38:03.481608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217cb62-d180-4349-965a-7580f903a1b7 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:03.516638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5a23c-df46-4086-9db6-f57adfc40807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:03.517281 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5a23c-df46-4086-9db6-f57adfc40807 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:03.517557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5a23c-df46-4086-9db6-f57adfc40807 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:03.517828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5a23c-df46-4086-9db6-f57adfc40807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:03.529319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5a23c-df46-4086-9db6-f57adfc40807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:03.530804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5a23c-df46-4086-9db6-f57adfc40807 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-6bb5a23c-df46-4086-9db6-f57adfc40807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:38:03.546109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:03.547145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:38:03.548071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:38:03.548071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:38:03.548071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:38:03.548071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 407/822] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:38:03.553897 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57566111-620e-46c9-9e22-d7232702c137 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:03.621895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:03.657661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57566111-620e-46c9-9e22-d7232702c137 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:03.690906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408c10f-9664-4bfe-84e9-51ca183c4b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:03.691544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408c10f-9664-4bfe-84e9-51ca183c4b19 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:03.691830 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408c10f-9664-4bfe-84e9-51ca183c4b19 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:03.692110 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408c10f-9664-4bfe-84e9-51ca183c4b19 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:03.692743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408c10f-9664-4bfe-84e9-51ca183c4b19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:03.693050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408c10f-9664-4bfe-84e9-51ca183c4b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:03.694404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408c10f-9664-4bfe-84e9-51ca183c4b19 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:03.705745 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 416/823] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:03.711528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5a23c-df46-4086-9db6-f57adfc40807 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:03.728117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:03.811063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5a23c-df46-4086-9db6-f57adfc40807 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:03.843814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af347e-19dc-4f2f-aec9-6ba9f448fd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:03.844442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af347e-19dc-4f2f-aec9-6ba9f448fd9e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:03.844724 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af347e-19dc-4f2f-aec9-6ba9f448fd9e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:03.845001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af347e-19dc-4f2f-aec9-6ba9f448fd9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:03.852420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af347e-19dc-4f2f-aec9-6ba9f448fd9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:03.853865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af347e-19dc-4f2f-aec9-6ba9f448fd9e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-c9af347e-19dc-4f2f-aec9-6ba9f448fd9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:38:03.866921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:03.868065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:38:03.869093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 408/824] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Oct 12 04:38:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:38:03.872166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408c10f-9664-4bfe-84e9-51ca183c4b19 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:03.971104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408c10f-9664-4bfe-84e9-51ca183c4b19 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:03.995884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:04.005305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a6ab3-fd70-44d9-a3db-6da907fd6233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:04.005913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6ab3-fd70-44d9-a3db-6da907fd6233 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:04.006199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6ab3-fd70-44d9-a3db-6da907fd6233 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:04.006480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6ab3-fd70-44d9-a3db-6da907fd6233 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:04.007197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a6ab3-fd70-44d9-a3db-6da907fd6233 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:04.007541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a6ab3-fd70-44d9-a3db-6da907fd6233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:04.008960 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a6ab3-fd70-44d9-a3db-6da907fd6233 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:04.025521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 417/825] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Oct 12 04:38:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:04.031259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af347e-19dc-4f2f-aec9-6ba9f448fd9e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:04.104887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:04.129550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af347e-19dc-4f2f-aec9-6ba9f448fd9e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:04.161902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867cfcf-f3bc-4d0e-897c-b699c49f5e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:04.162504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867cfcf-f3bc-4d0e-897c-b699c49f5e00 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:04.162783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867cfcf-f3bc-4d0e-897c-b699c49f5e00 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:04.163051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867cfcf-f3bc-4d0e-897c-b699c49f5e00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:04.227922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867cfcf-f3bc-4d0e-897c-b699c49f5e00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:04.229595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867cfcf-f3bc-4d0e-897c-b699c49f5e00 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:04.302201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:04.326371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 409/826] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:38:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:38:04.332625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a6ab3-fd70-44d9-a3db-6da907fd6233 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:04.426930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a6ab3-fd70-44d9-a3db-6da907fd6233 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:04.459273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6a92-2b38-43a3-9a36-710ece01a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:04.459909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6a92-2b38-43a3-9a36-710ece01a783 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:04.460186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6a92-2b38-43a3-9a36-710ece01a783 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:04.460456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6a92-2b38-43a3-9a36-710ece01a783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:04.470789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e6a92-2b38-43a3-9a36-710ece01a783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:04.472234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e6a92-2b38-43a3-9a36-710ece01a783 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-ed8e6a92-2b38-43a3-9a36-710ece01a783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:38:04.487118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:04.488230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:38:04.489125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:38:04.489125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:38:04.489125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:04.489125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 418/827] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:38:04.493774 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867cfcf-f3bc-4d0e-897c-b699c49f5e00 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:04.593405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867cfcf-f3bc-4d0e-897c-b699c49f5e00 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:04.626939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660d777-f14f-4f32-89b2-8fb47f1a6f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:04.627568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660d777-f14f-4f32-89b2-8fb47f1a6f27 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:04.627849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660d777-f14f-4f32-89b2-8fb47f1a6f27 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:04.628123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660d777-f14f-4f32-89b2-8fb47f1a6f27 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:04.628762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660d777-f14f-4f32-89b2-8fb47f1a6f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:04.629067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660d777-f14f-4f32-89b2-8fb47f1a6f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:04.630436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660d777-f14f-4f32-89b2-8fb47f1a6f27 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:04.641422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 410/828] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:04.647548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6a92-2b38-43a3-9a36-710ece01a783 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:04.682027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:04.745002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6a92-2b38-43a3-9a36-710ece01a783 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:04.777614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a11aff-df74-41b4-8a42-abe2da666828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:04.778234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a11aff-df74-41b4-8a42-abe2da666828 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:04.778514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a11aff-df74-41b4-8a42-abe2da666828 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:04.778786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a11aff-df74-41b4-8a42-abe2da666828 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:04.785137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a11aff-df74-41b4-8a42-abe2da666828 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:04.786564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a11aff-df74-41b4-8a42-abe2da666828 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-e1a11aff-df74-41b4-8a42-abe2da666828 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:38:04.797383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:04.798261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:04.799202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:38:04.799202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:38:04.799202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:38:04.799202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:38:04.799202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:38:04.799202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:38:04.799202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:38:04.799202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:04.799202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 419/829] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:38:04.804500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660d777-f14f-4f32-89b2-8fb47f1a6f27 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:04.838951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:05.014111 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660d777-f14f-4f32-89b2-8fb47f1a6f27 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:05.046880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4193a-0f5c-42a8-a014-14a4cd4c3fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:05.047518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4193a-0f5c-42a8-a014-14a4cd4c3fa2 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:05.047799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4193a-0f5c-42a8-a014-14a4cd4c3fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:05.048087 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4193a-0f5c-42a8-a014-14a4cd4c3fa2 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:05.049284 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4193a-0f5c-42a8-a014-14a4cd4c3fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:05.049586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4193a-0f5c-42a8-a014-14a4cd4c3fa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:05.050989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4193a-0f5c-42a8-a014-14a4cd4c3fa2 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:05.062394 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 411/830] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:05.069082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a11aff-df74-41b4-8a42-abe2da666828 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:05.159435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:05.165679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a11aff-df74-41b4-8a42-abe2da666828 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:05.199137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0ea4c-d924-4993-9168-6aa9b4e99782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:05.199767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0ea4c-d924-4993-9168-6aa9b4e99782 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:05.200048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0ea4c-d924-4993-9168-6aa9b4e99782 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:05.200320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0ea4c-d924-4993-9168-6aa9b4e99782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:05.201030 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0ea4c-d924-4993-9168-6aa9b4e99782 None admin] RBAC: Adding query filter params (role.id=cea949ae420a46e18943f9f02af359b7, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=7e02bef3699b4569986b36cec686931a) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:05.201337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0ea4c-d924-4993-9168-6aa9b4e99782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:05.202759 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0ea4c-d924-4993-9168-6aa9b4e99782 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:05.208491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 420/831] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:38:05 2022] GET /identity/v3/role_assignments?user.id=7e02bef3699b4569986b36cec686931a&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=cea949ae420a46e18943f9f02af359b7 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:05.552736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d429ab-dee8-496d-a4e5-e4b19dcddc25 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:05.553270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d429ab-dee8-496d-a4e5-e4b19dcddc25 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:05.553270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d429ab-dee8-496d-a4e5-e4b19dcddc25 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:05.557109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 412/832] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:05.560175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878bec1-67aa-4377-bc58-d549fae156be None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:05.560632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878bec1-67aa-4377-bc58-d549fae156be None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:05.560733 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878bec1-67aa-4377-bc58-d549fae156be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:05.581530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-0878bec1-67aa-4377-bc58-d549fae156be None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:05.582722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0878bec1-67aa-4377-bc58-d549fae156be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:05.649307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 421/833] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:05.919139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d429ab-dee8-496d-a4e5-e4b19dcddc25 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:06.014172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:06.022409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d429ab-dee8-496d-a4e5-e4b19dcddc25 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:06.055963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdbb59-4eb1-4070-86e3-553bfd2085c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:06.056609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdbb59-4eb1-4070-86e3-553bfd2085c1 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:06.056872 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdbb59-4eb1-4070-86e3-553bfd2085c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:06.057149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdbb59-4eb1-4070-86e3-553bfd2085c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:06.067475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdbb59-4eb1-4070-86e3-553bfd2085c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-9ecdbb59-4eb1-4070-86e3-553bfd2085c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:38:06.072236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:06.073333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:38:06.074373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 413/834] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:38:06.079587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878bec1-67aa-4377-bc58-d549fae156be None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:06.164506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:06.174783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878bec1-67aa-4377-bc58-d549fae156be None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:06.207485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddcf7e-0717-4af9-bbb7-b6b85c9b52bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:06.208075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddcf7e-0717-4af9-bbb7-b6b85c9b52bb None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:06.208358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddcf7e-0717-4af9-bbb7-b6b85c9b52bb None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:06.208630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddcf7e-0717-4af9-bbb7-b6b85c9b52bb None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:06.209277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddcf7e-0717-4af9-bbb7-b6b85c9b52bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:06.209577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddcf7e-0717-4af9-bbb7-b6b85c9b52bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:06.210930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddcf7e-0717-4af9-bbb7-b6b85c9b52bb None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:06.218896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 422/835] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:06.225774 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdbb59-4eb1-4070-86e3-553bfd2085c1 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:06.320410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdbb59-4eb1-4070-86e3-553bfd2085c1 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:06.352966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aa0e8-d8c4-47d9-ae44-9fff7d7e25a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:06.353578 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aa0e8-d8c4-47d9-ae44-9fff7d7e25a4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:06.353862 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aa0e8-d8c4-47d9-ae44-9fff7d7e25a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:06.354138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aa0e8-d8c4-47d9-ae44-9fff7d7e25a4 None admin] PATH_INFO: `/v3/users/82609856f83e4e8ba942dc728056454a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:06.355245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499aa0e8-d8c4-47d9-ae44-9fff7d7e25a4 None admin] RBAC: Authorizing `identity:get_user(user_id=82609856f83e4e8ba942dc728056454a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:06.356696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499aa0e8-d8c4-47d9-ae44-9fff7d7e25a4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:06.358227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 414/836] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:38:06 2022] GET /identity/v3/users/82609856f83e4e8ba942dc728056454a => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:06.363998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddcf7e-0717-4af9-bbb7-b6b85c9b52bb None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:06.459687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddcf7e-0717-4af9-bbb7-b6b85c9b52bb None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:06.491219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04a3e8-9436-467d-9e3e-358378a189ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:06.491839 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04a3e8-9436-467d-9e3e-358378a189ea None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:06.492119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04a3e8-9436-467d-9e3e-358378a189ea None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:06.492393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04a3e8-9436-467d-9e3e-358378a189ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:06.513166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:06.557648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04a3e8-9436-467d-9e3e-358378a189ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:06.559084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04a3e8-9436-467d-9e3e-358378a189ea None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:06.653871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 423/837] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:38:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:38:06.659977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aa0e8-d8c4-47d9-ae44-9fff7d7e25a4 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:06.684115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:06.757219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aa0e8-d8c4-47d9-ae44-9fff7d7e25a4 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:06.788629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f592e-c4a3-45e9-bbab-a7004a286b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:06.789242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f592e-c4a3-45e9-bbab-a7004a286b66 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:06.789527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f592e-c4a3-45e9-bbab-a7004a286b66 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:06.789802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f592e-c4a3-45e9-bbab-a7004a286b66 None admin] PATH_INFO: `/v3/projects/9191540691534f44bea585f95a7db9f7` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:06.790913 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f592e-c4a3-45e9-bbab-a7004a286b66 None admin] RBAC: Authorizing `identity:get_project(project_id=9191540691534f44bea585f95a7db9f7)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:06.792367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f592e-c4a3-45e9-bbab-a7004a286b66 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:06.793953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 415/838] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:38:06 2022] GET /identity/v3/projects/9191540691534f44bea585f95a7db9f7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:06.800471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04a3e8-9436-467d-9e3e-358378a189ea None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:06.850578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:06.896199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04a3e8-9436-467d-9e3e-358378a189ea None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:06.928856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d61a71-a96e-4dd6-be56-02e126e7f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:06.929450 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d61a71-a96e-4dd6-be56-02e126e7f469 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:06.929733 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d61a71-a96e-4dd6-be56-02e126e7f469 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:06.930011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d61a71-a96e-4dd6-be56-02e126e7f469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:06.930720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d61a71-a96e-4dd6-be56-02e126e7f469 None admin] RBAC: Adding query filter params (role.id=3d2307e73cdb4f6291f9735ac9359702, scope.project.id=9191540691534f44bea585f95a7db9f7, user.id=82609856f83e4e8ba942dc728056454a) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:06.931029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d61a71-a96e-4dd6-be56-02e126e7f469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:06.932470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d61a71-a96e-4dd6-be56-02e126e7f469 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:06.937980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 424/839] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:38:06 2022] GET /identity/v3/role_assignments?user.id=82609856f83e4e8ba942dc728056454a&scope.project.id=9191540691534f44bea585f95a7db9f7&role.id=3d2307e73cdb4f6291f9735ac9359702 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:09.039423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06187-4699-4ef2-b219-6fea3a758104 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:09.039954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06187-4699-4ef2-b219-6fea3a758104 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:09.039954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06187-4699-4ef2-b219-6fea3a758104 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:09.041299 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 416/840] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:09.046611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2a8d-ab7d-4c7b-a48c-35e7a4930916 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:09.047018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2a8d-ab7d-4c7b-a48c-35e7a4930916 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:09.047146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2a8d-ab7d-4c7b-a48c-35e7a4930916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:09.065658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-18ae2a8d-ab7d-4c7b-a48c-35e7a4930916 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:09.066812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-18ae2a8d-ab7d-4c7b-a48c-35e7a4930916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:09.128827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 425/841] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:09.393511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06187-4699-4ef2-b219-6fea3a758104 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:09.483188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:09.493565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06187-4699-4ef2-b219-6fea3a758104 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:09.526075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b3502-9e0b-41a7-b164-04ee55e25baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:09.526688 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b3502-9e0b-41a7-b164-04ee55e25baa None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:09.526968 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b3502-9e0b-41a7-b164-04ee55e25baa None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:09.527241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b3502-9e0b-41a7-b164-04ee55e25baa None admin] PATH_INFO: `/v3/domains/default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:09.528360 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b3502-9e0b-41a7-b164-04ee55e25baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:09.529775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b3502-9e0b-41a7-b164-04ee55e25baa None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:09.531386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 417/842] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:38:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:09.536967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2a8d-ab7d-4c7b-a48c-35e7a4930916 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:09.585394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:09.637076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2a8d-ab7d-4c7b-a48c-35e7a4930916 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:09.669001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f113c05-3538-4b96-bd56-9e274156a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:09.669550 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113c05-3538-4b96-bd56-9e274156a27e None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:09.669831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113c05-3538-4b96-bd56-9e274156a27e None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:09.670102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113c05-3538-4b96-bd56-9e274156a27e None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:09.670746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f113c05-3538-4b96-bd56-9e274156a27e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:09.672341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f113c05-3538-4b96-bd56-9e274156a27e None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:09.693058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 426/843] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:38:09 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:38:11.824408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb1e35-7372-446e-b275-6a44f0035f9c None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:11.824961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb1e35-7372-446e-b275-6a44f0035f9c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:11.824961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb1e35-7372-446e-b275-6a44f0035f9c None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:11.826277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 418/844] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:11.832038 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd81c-8491-4bba-afc0-e684c8d45208 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:11.832450 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd81c-8491-4bba-afc0-e684c8d45208 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:11.832553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd81c-8491-4bba-afc0-e684c8d45208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:11.851198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d6bdd81c-8491-4bba-afc0-e684c8d45208 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:11.852418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d6bdd81c-8491-4bba-afc0-e684c8d45208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:11.917109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 427/845] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:12.187198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb1e35-7372-446e-b275-6a44f0035f9c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:12.285354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb1e35-7372-446e-b275-6a44f0035f9c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:12.317413 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf33905-3bf5-459a-a4ed-7a385e0bb6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:12.318025 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf33905-3bf5-459a-a4ed-7a385e0bb6aa None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:12.318306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf33905-3bf5-459a-a4ed-7a385e0bb6aa None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:12.318579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf33905-3bf5-459a-a4ed-7a385e0bb6aa None admin] PATH_INFO: `/v3/roles/50ea03120ffe45e196a21607ebe0cc8a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:12.319976 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf33905-3bf5-459a-a4ed-7a385e0bb6aa None admin] RBAC: Authorizing `identity:get_role(role_id=50ea03120ffe45e196a21607ebe0cc8a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:12.321322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf33905-3bf5-459a-a4ed-7a385e0bb6aa None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:12.322604 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 419/846] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:38:12 2022] GET /identity/v3/roles/50ea03120ffe45e196a21607ebe0cc8a => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:12.328409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdd81c-8491-4bba-afc0-e684c8d45208 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:12.358156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:12.423927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdd81c-8491-4bba-afc0-e684c8d45208 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:12.457648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08be7a-8a49-4fec-a9bc-5438a2d79f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:12.458266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08be7a-8a49-4fec-a9bc-5438a2d79f40 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:12.458550 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08be7a-8a49-4fec-a9bc-5438a2d79f40 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:12.458827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08be7a-8a49-4fec-a9bc-5438a2d79f40 None admin] PATH_INFO: `/v3/users/48e917e658694b14a9eb1302fdf39d2e` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:12.471686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08be7a-8a49-4fec-a9bc-5438a2d79f40 None admin] RBAC: Authorizing `identity:get_user(user_id=48e917e658694b14a9eb1302fdf39d2e)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:12.473127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08be7a-8a49-4fec-a9bc-5438a2d79f40 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:12.474685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 428/847] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:38:12 2022] GET /identity/v3/users/48e917e658694b14a9eb1302fdf39d2e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:12.480314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf33905-3bf5-459a-a4ed-7a385e0bb6aa None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:12.506928 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:12.576749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf33905-3bf5-459a-a4ed-7a385e0bb6aa None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:12.609148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538715c3-0312-4527-ae9d-c3add0de04b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:12.609766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538715c3-0312-4527-ae9d-c3add0de04b4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:12.610045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538715c3-0312-4527-ae9d-c3add0de04b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:12.610808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538715c3-0312-4527-ae9d-c3add0de04b4 None admin] PATH_INFO: `/v3/projects/9191540691534f44bea585f95a7db9f7` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:12.611941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538715c3-0312-4527-ae9d-c3add0de04b4 None admin] RBAC: Authorizing `identity:get_project(project_id=9191540691534f44bea585f95a7db9f7)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:12.613356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538715c3-0312-4527-ae9d-c3add0de04b4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:12.614944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 420/848] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:38:12 2022] GET /identity/v3/projects/9191540691534f44bea585f95a7db9f7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:12.620887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08be7a-8a49-4fec-a9bc-5438a2d79f40 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:12.707232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:12.717064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08be7a-8a49-4fec-a9bc-5438a2d79f40 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:12.749204 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861809-f1b5-4caf-9056-e23feff45d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:12.749842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861809-f1b5-4caf-9056-e23feff45d14 None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:12.750117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861809-f1b5-4caf-9056-e23feff45d14 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:12.750390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861809-f1b5-4caf-9056-e23feff45d14 None admin] PATH_INFO: `/v3/projects/9191540691534f44bea585f95a7db9f7/users/48e917e658694b14a9eb1302fdf39d2e/roles/50ea03120ffe45e196a21607ebe0cc8a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:12.753092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861809-f1b5-4caf-9056-e23feff45d14 None admin] RBAC: Authorizing `identity:create_grant(project_id=9191540691534f44bea585f95a7db9f7, user_id=48e917e658694b14a9eb1302fdf39d2e, role_id=50ea03120ffe45e196a21607ebe0cc8a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:12.754872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861809-f1b5-4caf-9056-e23feff45d14 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:12.767560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 429/849] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:38:12 2022] PUT /identity/v3/projects/9191540691534f44bea585f95a7db9f7/users/48e917e658694b14a9eb1302fdf39d2e/roles/50ea03120ffe45e196a21607ebe0cc8a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:38:14.867249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff93cf-212a-49f4-965a-7e6dcb257974 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:14.867768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff93cf-212a-49f4-965a-7e6dcb257974 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:14.867768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff93cf-212a-49f4-965a-7e6dcb257974 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:14.869073 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 421/850] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:14.874440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bccd91-324f-4c17-a584-8584010f3eda None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:14.874840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bccd91-324f-4c17-a584-8584010f3eda None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:14.874992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bccd91-324f-4c17-a584-8584010f3eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:14.893160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-54bccd91-324f-4c17-a584-8584010f3eda None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:14.894369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-54bccd91-324f-4c17-a584-8584010f3eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:14.958114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 430/851] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:15.224075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff93cf-212a-49f4-965a-7e6dcb257974 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:15.314895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:15.322232 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff93cf-212a-49f4-965a-7e6dcb257974 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:15.354399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72efc3-f154-4bb7-bcde-0eedf6fa7f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:15.355005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72efc3-f154-4bb7-bcde-0eedf6fa7f00 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:15.355298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72efc3-f154-4bb7-bcde-0eedf6fa7f00 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:15.355588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72efc3-f154-4bb7-bcde-0eedf6fa7f00 None admin] PATH_INFO: `/v3/roles/50ea03120ffe45e196a21607ebe0cc8a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:15.356935 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72efc3-f154-4bb7-bcde-0eedf6fa7f00 None admin] RBAC: Authorizing `identity:get_role(role_id=50ea03120ffe45e196a21607ebe0cc8a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:15.358279 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72efc3-f154-4bb7-bcde-0eedf6fa7f00 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:15.359595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 422/852] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:38:15 2022] GET /identity/v3/roles/50ea03120ffe45e196a21607ebe0cc8a => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:15.365411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bccd91-324f-4c17-a584-8584010f3eda None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:15.441321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:15.460901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bccd91-324f-4c17-a584-8584010f3eda None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:15.492938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fffa7-b7ec-4c34-8875-b5ac565cb3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:15.493499 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fffa7-b7ec-4c34-8875-b5ac565cb3c0 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:15.493780 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fffa7-b7ec-4c34-8875-b5ac565cb3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:15.494055 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fffa7-b7ec-4c34-8875-b5ac565cb3c0 None admin] PATH_INFO: `/v3/users/48e917e658694b14a9eb1302fdf39d2e` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:15.495148 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fffa7-b7ec-4c34-8875-b5ac565cb3c0 None admin] RBAC: Authorizing `identity:get_user(user_id=48e917e658694b14a9eb1302fdf39d2e)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:15.496600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fffa7-b7ec-4c34-8875-b5ac565cb3c0 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:15.498132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 431/853] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:38:15 2022] GET /identity/v3/users/48e917e658694b14a9eb1302fdf39d2e => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:15.504172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72efc3-f154-4bb7-bcde-0eedf6fa7f00 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:15.599634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72efc3-f154-4bb7-bcde-0eedf6fa7f00 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:15.631121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782a14a-97e0-468a-95f8-9880c4210826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:15.631755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a14a-97e0-468a-95f8-9880c4210826 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:15.632032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a14a-97e0-468a-95f8-9880c4210826 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:15.632300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a14a-97e0-468a-95f8-9880c4210826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:15.660445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:15.696818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782a14a-97e0-468a-95f8-9880c4210826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:15.698236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782a14a-97e0-468a-95f8-9880c4210826 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:15.790120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 423/854] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:38:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:38:15.795917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fffa7-b7ec-4c34-8875-b5ac565cb3c0 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:15.890824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fffa7-b7ec-4c34-8875-b5ac565cb3c0 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:15.924261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b284798-be6c-4025-bb41-72216d627b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:15.924877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284798-be6c-4025-bb41-72216d627b88 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:15.925154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284798-be6c-4025-bb41-72216d627b88 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:15.925424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284798-be6c-4025-bb41-72216d627b88 None admin] PATH_INFO: `/v3/projects/9191540691534f44bea585f95a7db9f7` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:15.926513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b284798-be6c-4025-bb41-72216d627b88 None admin] RBAC: Authorizing `identity:get_project(project_id=9191540691534f44bea585f95a7db9f7)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:15.927955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b284798-be6c-4025-bb41-72216d627b88 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:15.929548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 432/855] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:38:15 2022] GET /identity/v3/projects/9191540691534f44bea585f95a7db9f7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:15.935739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782a14a-97e0-468a-95f8-9880c4210826 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:15.994993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:16.031621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782a14a-97e0-468a-95f8-9880c4210826 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:16.064045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bacb7-e204-4cd5-8a05-118c086e6e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:16.064576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bacb7-e204-4cd5-8a05-118c086e6e8c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:16.064853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bacb7-e204-4cd5-8a05-118c086e6e8c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:16.065122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bacb7-e204-4cd5-8a05-118c086e6e8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:16.065830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bacb7-e204-4cd5-8a05-118c086e6e8c None admin] RBAC: Adding query filter params (role.id=50ea03120ffe45e196a21607ebe0cc8a, scope.project.id=9191540691534f44bea585f95a7db9f7, user.id=48e917e658694b14a9eb1302fdf39d2e) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:16.066133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bacb7-e204-4cd5-8a05-118c086e6e8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:16.067544 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bacb7-e204-4cd5-8a05-118c086e6e8c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:16.072958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 424/856] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:38:15 2022] GET /identity/v3/role_assignments?user.id=48e917e658694b14a9eb1302fdf39d2e&scope.project.id=9191540691534f44bea585f95a7db9f7&role.id=50ea03120ffe45e196a21607ebe0cc8a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:18.204485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f6889-a0b1-44eb-91a8-c023e54ebaca None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:18.205011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f6889-a0b1-44eb-91a8-c023e54ebaca None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:18.205011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f6889-a0b1-44eb-91a8-c023e54ebaca None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:18.206374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 433/857] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:18.211635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0c91f-2da5-4681-b4ee-30cfde1e8ad5 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:18.212023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0c91f-2da5-4681-b4ee-30cfde1e8ad5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:18.212191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0c91f-2da5-4681-b4ee-30cfde1e8ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:18.230753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-2cd0c91f-2da5-4681-b4ee-30cfde1e8ad5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:18.231962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2cd0c91f-2da5-4681-b4ee-30cfde1e8ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:18.295113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 425/858] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:18.561340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f6889-a0b1-44eb-91a8-c023e54ebaca None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:18.580176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:18.662180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f6889-a0b1-44eb-91a8-c023e54ebaca None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:18.695698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff16018-48c9-4472-8fc8-60685f604fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:18.696316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16018-48c9-4472-8fc8-60685f604fda None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:18.696595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16018-48c9-4472-8fc8-60685f604fda None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:18.696868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16018-48c9-4472-8fc8-60685f604fda None admin] PATH_INFO: `/v3/domains/default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:18.697960 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff16018-48c9-4472-8fc8-60685f604fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:18.699659 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff16018-48c9-4472-8fc8-60685f604fda None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:18.701185 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 434/859] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:38:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:18.706988 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0c91f-2da5-4681-b4ee-30cfde1e8ad5 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:18.760641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:18.802212 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0c91f-2da5-4681-b4ee-30cfde1e8ad5 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:18.834697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390c068-46ef-47cb-a9b9-49a8baa27018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:18.835237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c068-46ef-47cb-a9b9-49a8baa27018 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:18.835554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c068-46ef-47cb-a9b9-49a8baa27018 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:18.835832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c068-46ef-47cb-a9b9-49a8baa27018 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:18.836485 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390c068-46ef-47cb-a9b9-49a8baa27018 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:18.837902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390c068-46ef-47cb-a9b9-49a8baa27018 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:18.863491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 426/860] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:38:18 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:38:21.000352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc342c-8b15-4628-be8b-e6ee430029b7 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:21.000946 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc342c-8b15-4628-be8b-e6ee430029b7 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:21.000946 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc342c-8b15-4628-be8b-e6ee430029b7 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:21.002262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 435/861] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:21.007636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1977d-f5cc-4f05-80bc-fe34826c9071 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:21.008036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1977d-f5cc-4f05-80bc-fe34826c9071 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:21.008181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1977d-f5cc-4f05-80bc-fe34826c9071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:21.026170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-17a1977d-f5cc-4f05-80bc-fe34826c9071 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:21.027370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-17a1977d-f5cc-4f05-80bc-fe34826c9071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:21.091160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 427/862] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:38:21.358340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc342c-8b15-4628-be8b-e6ee430029b7 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:21.440423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:21.457285 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc342c-8b15-4628-be8b-e6ee430029b7 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:21.489154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c90783-a28f-4143-a719-e04916939dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:21.489771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90783-a28f-4143-a719-e04916939dd8 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:21.490049 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90783-a28f-4143-a719-e04916939dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:21.490320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90783-a28f-4143-a719-e04916939dd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:21.491432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90783-a28f-4143-a719-e04916939dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:21.492849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90783-a28f-4143-a719-e04916939dd8 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:21.494380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 436/863] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:38:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:21.500146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1977d-f5cc-4f05-80bc-fe34826c9071 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:21.538001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:21.596222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1977d-f5cc-4f05-80bc-fe34826c9071 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:21.628893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ceca64-e3b0-404e-8b6f-68acaa862573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:21.629429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceca64-e3b0-404e-8b6f-68acaa862573 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:21.629707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceca64-e3b0-404e-8b6f-68acaa862573 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:21.629976 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceca64-e3b0-404e-8b6f-68acaa862573 None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:21.630616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ceca64-e3b0-404e-8b6f-68acaa862573 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:21.632112 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ceca64-e3b0-404e-8b6f-68acaa862573 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:21.652878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 428/864] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:38:21 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:38:23.757243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9fac6-92d0-4afb-bd52-68701be00836 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:23.757764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9fac6-92d0-4afb-bd52-68701be00836 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:23.757764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9fac6-92d0-4afb-bd52-68701be00836 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:23.759144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 437/865] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:23.764176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcaa48-5ec6-4963-8ae9-e3e88240ba3b None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:23.764595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcaa48-5ec6-4963-8ae9-e3e88240ba3b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:23.764741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcaa48-5ec6-4963-8ae9-e3e88240ba3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:23.783157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-40dcaa48-5ec6-4963-8ae9-e3e88240ba3b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:23.784376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-40dcaa48-5ec6-4963-8ae9-e3e88240ba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:23.848654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 429/866] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:24.113467 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9fac6-92d0-4afb-bd52-68701be00836 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:24.211288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9fac6-92d0-4afb-bd52-68701be00836 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:24.245421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db63d6-e6da-452b-9449-1f6dd1bde048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:24.246042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db63d6-e6da-452b-9449-1f6dd1bde048 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:24.246324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db63d6-e6da-452b-9449-1f6dd1bde048 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:24.246599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db63d6-e6da-452b-9449-1f6dd1bde048 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:24.256540 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db63d6-e6da-452b-9449-1f6dd1bde048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-c7db63d6-e6da-452b-9449-1f6dd1bde048 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:38:24.261337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:24.262247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:24.263094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 438/867] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:38:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:38:24.268336 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcaa48-5ec6-4963-8ae9-e3e88240ba3b None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:24.292271 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:24.363628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcaa48-5ec6-4963-8ae9-e3e88240ba3b None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:24.394807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4430c0-31fe-4412-b4c3-076b6729ce93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:24.395422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4430c0-31fe-4412-b4c3-076b6729ce93 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:24.395702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4430c0-31fe-4412-b4c3-076b6729ce93 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:24.395972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4430c0-31fe-4412-b4c3-076b6729ce93 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:24.396624 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4430c0-31fe-4412-b4c3-076b6729ce93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:24.396922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4430c0-31fe-4412-b4c3-076b6729ce93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:24.398268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4430c0-31fe-4412-b4c3-076b6729ce93 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:24.405816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 430/868] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:38:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:24.411841 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db63d6-e6da-452b-9449-1f6dd1bde048 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:24.427098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:24.508850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db63d6-e6da-452b-9449-1f6dd1bde048 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:24.540993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13f875-8b85-40a8-b1e2-c0abff449109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:24.541610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f875-8b85-40a8-b1e2-c0abff449109 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:24.541895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f875-8b85-40a8-b1e2-c0abff449109 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:24.542173 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f875-8b85-40a8-b1e2-c0abff449109 None admin] PATH_INFO: `/v3/users/5fe11d5219224a16be076a398797f0fc` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:24.554701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13f875-8b85-40a8-b1e2-c0abff449109 None admin] RBAC: Authorizing `identity:get_user(user_id=5fe11d5219224a16be076a398797f0fc)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:24.556475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13f875-8b85-40a8-b1e2-c0abff449109 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:24.558078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 439/869] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:38:24 2022] GET /identity/v3/users/5fe11d5219224a16be076a398797f0fc => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:24.563861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4430c0-31fe-4412-b4c3-076b6729ce93 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:24.649331 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:24.664266 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4430c0-31fe-4412-b4c3-076b6729ce93 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:24.695651 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6d572-6648-4e48-82b8-bb3d4ba49898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:24.696268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6d572-6648-4e48-82b8-bb3d4ba49898 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:24.696546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6d572-6648-4e48-82b8-bb3d4ba49898 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:24.696815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6d572-6648-4e48-82b8-bb3d4ba49898 None admin] PATH_INFO: `/v3/projects/a467b82c1577440294ec24d5e477058f` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:24.697906 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6d572-6648-4e48-82b8-bb3d4ba49898 None admin] RBAC: Authorizing `identity:get_project(project_id=a467b82c1577440294ec24d5e477058f)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:24.699340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6d572-6648-4e48-82b8-bb3d4ba49898 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:24.700911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 431/870] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:38:24 2022] GET /identity/v3/projects/a467b82c1577440294ec24d5e477058f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:24.707376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13f875-8b85-40a8-b1e2-c0abff449109 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:24.774494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:24.804985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13f875-8b85-40a8-b1e2-c0abff449109 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:24.837547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d6d5a-e558-4b6a-81a3-1ccc7da092da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:24.838196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d6d5a-e558-4b6a-81a3-1ccc7da092da None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:24.838480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d6d5a-e558-4b6a-81a3-1ccc7da092da None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:24.839024 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d6d5a-e558-4b6a-81a3-1ccc7da092da None admin] PATH_INFO: `/v3/projects/a467b82c1577440294ec24d5e477058f/users/5fe11d5219224a16be076a398797f0fc/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:24.840938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d6d5a-e558-4b6a-81a3-1ccc7da092da None admin] RBAC: Authorizing `identity:create_grant(project_id=a467b82c1577440294ec24d5e477058f, user_id=5fe11d5219224a16be076a398797f0fc, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:24.842362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d6d5a-e558-4b6a-81a3-1ccc7da092da None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:24.855195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 440/871] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:38:24 2022] PUT /identity/v3/projects/a467b82c1577440294ec24d5e477058f/users/5fe11d5219224a16be076a398797f0fc/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:38:26.931695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059bca3-af19-414f-b66e-5d5a23eb7617 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:26.932188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059bca3-af19-414f-b66e-5d5a23eb7617 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:26.932188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059bca3-af19-414f-b66e-5d5a23eb7617 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:26.933473 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 432/872] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:26.938579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5308fe0-4066-4051-836d-cee1bda0fcf5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:26.938970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5308fe0-4066-4051-836d-cee1bda0fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:26.939137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5308fe0-4066-4051-836d-cee1bda0fcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:26.957347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d5308fe0-4066-4051-836d-cee1bda0fcf5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:26.958509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d5308fe0-4066-4051-836d-cee1bda0fcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:27.023039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 441/873] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:27.287207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059bca3-af19-414f-b66e-5d5a23eb7617 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:27.382823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059bca3-af19-414f-b66e-5d5a23eb7617 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:27.414440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c1738-a7b4-46fc-91c3-4ff3187861c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:27.415044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1738-a7b4-46fc-91c3-4ff3187861c1 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:27.415343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1738-a7b4-46fc-91c3-4ff3187861c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:27.415614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1738-a7b4-46fc-91c3-4ff3187861c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:27.425734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c1738-a7b4-46fc-91c3-4ff3187861c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-777c1738-a7b4-46fc-91c3-4ff3187861c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:38:27.430435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:27.431533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:38:27.432390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 433/874] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:38:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:38:27.437320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5308fe0-4066-4051-836d-cee1bda0fcf5 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:27.494121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:27.533380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5308fe0-4066-4051-836d-cee1bda0fcf5 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:27.566345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94110d21-88ba-43cc-bc6d-2d55ae64815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:27.566891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94110d21-88ba-43cc-bc6d-2d55ae64815d None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:27.567177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94110d21-88ba-43cc-bc6d-2d55ae64815d None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:27.567492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94110d21-88ba-43cc-bc6d-2d55ae64815d None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:27.568183 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94110d21-88ba-43cc-bc6d-2d55ae64815d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:27.568489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94110d21-88ba-43cc-bc6d-2d55ae64815d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:27.569852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94110d21-88ba-43cc-bc6d-2d55ae64815d None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:27.577851 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 442/875] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:38:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:27.584695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c1738-a7b4-46fc-91c3-4ff3187861c1 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:27.600636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:27.681654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c1738-a7b4-46fc-91c3-4ff3187861c1 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:27.713571 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21137d1b-b286-469b-ad5d-35f05e560211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:27.714434 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137d1b-b286-469b-ad5d-35f05e560211 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:27.714708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137d1b-b286-469b-ad5d-35f05e560211 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:27.714975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137d1b-b286-469b-ad5d-35f05e560211 None admin] PATH_INFO: `/v3/users/5fe11d5219224a16be076a398797f0fc` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:27.716109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21137d1b-b286-469b-ad5d-35f05e560211 None admin] RBAC: Authorizing `identity:get_user(user_id=5fe11d5219224a16be076a398797f0fc)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:27.717516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21137d1b-b286-469b-ad5d-35f05e560211 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:27.719610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 434/876] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:38:27 2022] GET /identity/v3/users/5fe11d5219224a16be076a398797f0fc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:27.725434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94110d21-88ba-43cc-bc6d-2d55ae64815d None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:27.826597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94110d21-88ba-43cc-bc6d-2d55ae64815d None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:27.849135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:27.861391 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad8575-65be-49af-8aef-06f674b63867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:27.861999 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8575-65be-49af-8aef-06f674b63867 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:27.862283 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8575-65be-49af-8aef-06f674b63867 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:27.862560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad8575-65be-49af-8aef-06f674b63867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:27.929753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad8575-65be-49af-8aef-06f674b63867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:27.931203 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad8575-65be-49af-8aef-06f674b63867 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:28.028019 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 443/877] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:38:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:38:28.037456 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21137d1b-b286-469b-ad5d-35f05e560211 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:28.116906 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:28.135045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21137d1b-b286-469b-ad5d-35f05e560211 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:28.168728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d8e97-5803-4dcd-9bd7-3a4f8b767b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:28.169353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8e97-5803-4dcd-9bd7-3a4f8b767b74 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:28.169633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8e97-5803-4dcd-9bd7-3a4f8b767b74 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:28.169905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8e97-5803-4dcd-9bd7-3a4f8b767b74 None admin] PATH_INFO: `/v3/projects/a467b82c1577440294ec24d5e477058f` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:28.171009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d8e97-5803-4dcd-9bd7-3a4f8b767b74 None admin] RBAC: Authorizing `identity:get_project(project_id=a467b82c1577440294ec24d5e477058f)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:28.172488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d8e97-5803-4dcd-9bd7-3a4f8b767b74 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:28.174080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 435/878] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:38:28 2022] GET /identity/v3/projects/a467b82c1577440294ec24d5e477058f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:28.180195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad8575-65be-49af-8aef-06f674b63867 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:28.205048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:28.280121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad8575-65be-49af-8aef-06f674b63867 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:28.313467 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd2113-7456-458f-9dee-2a65dcf4c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:28.314065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd2113-7456-458f-9dee-2a65dcf4c9de None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:28.314351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd2113-7456-458f-9dee-2a65dcf4c9de None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:28.314628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd2113-7456-458f-9dee-2a65dcf4c9de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:28.315372 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd2113-7456-458f-9dee-2a65dcf4c9de None admin] RBAC: Adding query filter params (role.id=3d2307e73cdb4f6291f9735ac9359702, scope.project.id=a467b82c1577440294ec24d5e477058f, user.id=5fe11d5219224a16be076a398797f0fc) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:28.315685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd2113-7456-458f-9dee-2a65dcf4c9de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:28.317135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd2113-7456-458f-9dee-2a65dcf4c9de None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:28.322709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 444/879] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:38:28 2022] GET /identity/v3/role_assignments?user.id=5fe11d5219224a16be076a398797f0fc&scope.project.id=a467b82c1577440294ec24d5e477058f&role.id=3d2307e73cdb4f6291f9735ac9359702 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:30.423033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1c2c5-8573-4c3b-aafe-c24d48f44b39 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:30.423707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1c2c5-8573-4c3b-aafe-c24d48f44b39 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:30.423707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1c2c5-8573-4c3b-aafe-c24d48f44b39 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:30.424908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 436/880] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:30.429977 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2da6-81db-42cc-a73e-09bd7bd7975e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:30.430417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2da6-81db-42cc-a73e-09bd7bd7975e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:30.430537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2da6-81db-42cc-a73e-09bd7bd7975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:30.448652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a98d2da6-81db-42cc-a73e-09bd7bd7975e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:30.449826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a98d2da6-81db-42cc-a73e-09bd7bd7975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:30.513557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 445/881] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:30.779527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1c2c5-8573-4c3b-aafe-c24d48f44b39 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:30.876996 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1c2c5-8573-4c3b-aafe-c24d48f44b39 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:30.908294 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2a56c-714a-4207-ba60-0be3f9ef0d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:30.908873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2a56c-714a-4207-ba60-0be3f9ef0d8e None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:30.909149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2a56c-714a-4207-ba60-0be3f9ef0d8e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:30.909415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2a56c-714a-4207-ba60-0be3f9ef0d8e None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:30.910075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2a56c-714a-4207-ba60-0be3f9ef0d8e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:30.911446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2a56c-714a-4207-ba60-0be3f9ef0d8e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:30.927766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 437/882] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Oct 12 04:38:30 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:38:33.058655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457eb19-9eac-4d91-ba59-5fc342b5ce8f None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:33.059218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457eb19-9eac-4d91-ba59-5fc342b5ce8f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:33.059218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457eb19-9eac-4d91-ba59-5fc342b5ce8f None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:33.060578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 446/883] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:33.066211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056cb10-f457-4307-bb17-52c791ae0465 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:33.066636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056cb10-f457-4307-bb17-52c791ae0465 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:33.066733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056cb10-f457-4307-bb17-52c791ae0465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:33.084339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-a056cb10-f457-4307-bb17-52c791ae0465 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:33.085528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a056cb10-f457-4307-bb17-52c791ae0465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:33.088221 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:33.149721 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 438/884] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:38:33.412261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457eb19-9eac-4d91-ba59-5fc342b5ce8f None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:33.430266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:33.510541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457eb19-9eac-4d91-ba59-5fc342b5ce8f None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:33.542850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f8c33-c5f8-436d-8a6d-5536fbc7e66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:33.543490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f8c33-c5f8-436d-8a6d-5536fbc7e66e None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:33.543775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f8c33-c5f8-436d-8a6d-5536fbc7e66e None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:33.544050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f8c33-c5f8-436d-8a6d-5536fbc7e66e None admin] PATH_INFO: `/v3/domains/01aab08b048f4bb698b67b989aa1e944` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:33.554167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f8c33-c5f8-436d-8a6d-5536fbc7e66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=01aab08b048f4bb698b67b989aa1e944)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:33.555645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f8c33-c5f8-436d-8a6d-5536fbc7e66e None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:33.557213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 447/885] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Oct 12 04:38:33 2022] GET /identity/v3/domains/01aab08b048f4bb698b67b989aa1e944 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:33.562957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056cb10-f457-4307-bb17-52c791ae0465 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:33.658620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056cb10-f457-4307-bb17-52c791ae0465 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:33.690667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee90c4-0f91-4624-8555-36df37966d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:33.691207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee90c4-0f91-4624-8555-36df37966d01 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:33.691516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee90c4-0f91-4624-8555-36df37966d01 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:33.691792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee90c4-0f91-4624-8555-36df37966d01 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:33.692445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee90c4-0f91-4624-8555-36df37966d01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:33.693860 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee90c4-0f91-4624-8555-36df37966d01 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:33.704832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:33.721801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 439/886] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:38:33 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:38:35.855270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d84d-e6e3-41ee-9173-9478ece83f6d None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:35.855813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d84d-e6e3-41ee-9173-9478ece83f6d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:35.855813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d84d-e6e3-41ee-9173-9478ece83f6d None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:35.857092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 448/887] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:35.862749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a023a-1376-454c-90ae-3026dcc49506 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:35.863173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a023a-1376-454c-90ae-3026dcc49506 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:35.863304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a023a-1376-454c-90ae-3026dcc49506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:35.882067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-599a023a-1376-454c-90ae-3026dcc49506 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:35.883229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-599a023a-1376-454c-90ae-3026dcc49506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:35.946263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 440/888] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:38:36.212108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53d84d-e6e3-41ee-9173-9478ece83f6d None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:36.288500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:36.312171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53d84d-e6e3-41ee-9173-9478ece83f6d None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:36.344260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60eb27-b82d-48e0-9b3f-f2d12b7c4bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:36.344874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60eb27-b82d-48e0-9b3f-f2d12b7c4bea None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:36.345148 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60eb27-b82d-48e0-9b3f-f2d12b7c4bea None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:36.345415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60eb27-b82d-48e0-9b3f-f2d12b7c4bea None admin] PATH_INFO: `/v3/domains/01aab08b048f4bb698b67b989aa1e944` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:36.346501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60eb27-b82d-48e0-9b3f-f2d12b7c4bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=01aab08b048f4bb698b67b989aa1e944)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:36.347956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60eb27-b82d-48e0-9b3f-f2d12b7c4bea None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:36.349479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 449/889] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Oct 12 04:38:36 2022] GET /identity/v3/domains/01aab08b048f4bb698b67b989aa1e944 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:36.355193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a023a-1376-454c-90ae-3026dcc49506 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:36.448971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a023a-1376-454c-90ae-3026dcc49506 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:36.470973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:36.483653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2828c-0c5c-4670-9ae0-0da720f0a4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:36.484788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2828c-0c5c-4670-9ae0-0da720f0a4f4 None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:36.485068 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2828c-0c5c-4670-9ae0-0da720f0a4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:36.485341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2828c-0c5c-4670-9ae0-0da720f0a4f4 None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:36.485979 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2828c-0c5c-4670-9ae0-0da720f0a4f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:36.487420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2828c-0c5c-4670-9ae0-0da720f0a4f4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:36.507069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 441/890] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:38:36 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:38:38.641956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1143-cd47-423a-9aca-834b011651ea None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:38.642440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1143-cd47-423a-9aca-834b011651ea None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:38.642539 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1143-cd47-423a-9aca-834b011651ea None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:38.643882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 450/891] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:38.648882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c95f9-ad15-4eda-8004-de709e5adaa8 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:38.649278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c95f9-ad15-4eda-8004-de709e5adaa8 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:38.649447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c95f9-ad15-4eda-8004-de709e5adaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:38.667881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5e3c95f9-ad15-4eda-8004-de709e5adaa8 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:38.669052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5e3c95f9-ad15-4eda-8004-de709e5adaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:38.732798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 442/892] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:38.997583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc1143-cd47-423a-9aca-834b011651ea None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:39.095354 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc1143-cd47-423a-9aca-834b011651ea None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:39.128592 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab5944-d018-493f-91d4-4f56a7a74dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:39.129206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab5944-d018-493f-91d4-4f56a7a74dae None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:39.129489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab5944-d018-493f-91d4-4f56a7a74dae None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:39.129765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab5944-d018-493f-91d4-4f56a7a74dae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:39.139587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab5944-d018-493f-91d4-4f56a7a74dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-56ab5944-d018-493f-91d4-4f56a7a74dae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:38:39.144328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:39.145457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:38:39.146508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 451/893] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:38:39.151180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c95f9-ad15-4eda-8004-de709e5adaa8 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:39.246304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c95f9-ad15-4eda-8004-de709e5adaa8 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:39.255150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:39.279269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7335a62-8b72-4a05-9256-92b044af753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:39.279888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7335a62-8b72-4a05-9256-92b044af753e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:39.280169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7335a62-8b72-4a05-9256-92b044af753e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:39.280442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7335a62-8b72-4a05-9256-92b044af753e None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:39.281591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7335a62-8b72-4a05-9256-92b044af753e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:39.281898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7335a62-8b72-4a05-9256-92b044af753e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:39.283249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7335a62-8b72-4a05-9256-92b044af753e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:39.290939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 443/894] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:39.297373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab5944-d018-493f-91d4-4f56a7a74dae None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:39.301644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:39.391929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab5944-d018-493f-91d4-4f56a7a74dae None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:39.425251 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaac275-ccbe-4574-b265-e571afde8039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:39.425875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaac275-ccbe-4574-b265-e571afde8039 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:39.426157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaac275-ccbe-4574-b265-e571afde8039 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:39.426436 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaac275-ccbe-4574-b265-e571afde8039 None admin] PATH_INFO: `/v3/users/28ac44ee27f74cf895d6ce23ae65b4cb` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:39.439005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaac275-ccbe-4574-b265-e571afde8039 None admin] RBAC: Authorizing `identity:get_user(user_id=28ac44ee27f74cf895d6ce23ae65b4cb)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:39.440479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaac275-ccbe-4574-b265-e571afde8039 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:39.442056 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 452/895] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:38:39 2022] GET /identity/v3/users/28ac44ee27f74cf895d6ce23ae65b4cb => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:39.447753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7335a62-8b72-4a05-9256-92b044af753e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:39.541749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7335a62-8b72-4a05-9256-92b044af753e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:39.575996 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3487c58-f2e7-488b-ace4-98c3cd2e71ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:39.576630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3487c58-f2e7-488b-ace4-98c3cd2e71ae None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:39.576910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3487c58-f2e7-488b-ace4-98c3cd2e71ae None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:39.577185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3487c58-f2e7-488b-ace4-98c3cd2e71ae None admin] PATH_INFO: `/v3/projects/46f6b955153947358d899e7532918d5f` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:39.578839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3487c58-f2e7-488b-ace4-98c3cd2e71ae None admin] RBAC: Authorizing `identity:get_project(project_id=46f6b955153947358d899e7532918d5f)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:39.580286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3487c58-f2e7-488b-ace4-98c3cd2e71ae None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:39.581889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 444/896] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:38:39 2022] GET /identity/v3/projects/46f6b955153947358d899e7532918d5f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:39.587699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaac275-ccbe-4574-b265-e571afde8039 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:39.647169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:39.685687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaac275-ccbe-4574-b265-e571afde8039 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:39.719665 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcefea-efb4-489f-b5a7-fcf37da49a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:39.720313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcefea-efb4-489f-b5a7-fcf37da49a0b None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:39.720593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcefea-efb4-489f-b5a7-fcf37da49a0b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:39.720870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcefea-efb4-489f-b5a7-fcf37da49a0b None admin] PATH_INFO: `/v3/projects/46f6b955153947358d899e7532918d5f/users/28ac44ee27f74cf895d6ce23ae65b4cb/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:39.722748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcefea-efb4-489f-b5a7-fcf37da49a0b None admin] RBAC: Authorizing `identity:create_grant(project_id=46f6b955153947358d899e7532918d5f, user_id=28ac44ee27f74cf895d6ce23ae65b4cb, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:39.724192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcefea-efb4-489f-b5a7-fcf37da49a0b None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:39.736235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 453/897] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:38:39 2022] PUT /identity/v3/projects/46f6b955153947358d899e7532918d5f/users/28ac44ee27f74cf895d6ce23ae65b4cb/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:38:41.834691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38a49-bb51-46cf-857b-de9f8173e105 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:41.835189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38a49-bb51-46cf-857b-de9f8173e105 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:41.835189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38a49-bb51-46cf-857b-de9f8173e105 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:41.836489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 445/898] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:38:41.841993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c974e-92df-406c-adc1-6413c969daa8 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:41.842355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c974e-92df-406c-adc1-6413c969daa8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:41.842544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c974e-92df-406c-adc1-6413c969daa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:41.860821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b03c974e-92df-406c-adc1-6413c969daa8 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:38:41.861998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b03c974e-92df-406c-adc1-6413c969daa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:38:41.925517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 454/899] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:38:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:38:42.191701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38a49-bb51-46cf-857b-de9f8173e105 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:42.232106 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:42.290390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38a49-bb51-46cf-857b-de9f8173e105 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:42.322591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6cde-fc70-41a7-b344-b9d085b9503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:42.323206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6cde-fc70-41a7-b344-b9d085b9503d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:42.323512 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6cde-fc70-41a7-b344-b9d085b9503d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:42.323789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6cde-fc70-41a7-b344-b9d085b9503d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:42.334214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e6cde-fc70-41a7-b344-b9d085b9503d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-058e6cde-fc70-41a7-b344-b9d085b9503d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:38:42.338986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:38:42.340130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:38:42.341325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 446/900] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:38:42.346094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c974e-92df-406c-adc1-6413c969daa8 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:42.396028 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:42.440976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c974e-92df-406c-adc1-6413c969daa8 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:42.473321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1ff1e-9674-4ea8-8e19-e712b3507ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:42.473917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ff1e-9674-4ea8-8e19-e712b3507ffb None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:42.474199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ff1e-9674-4ea8-8e19-e712b3507ffb None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:42.474473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ff1e-9674-4ea8-8e19-e712b3507ffb None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:42.475125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1ff1e-9674-4ea8-8e19-e712b3507ffb None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:42.475455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1ff1e-9674-4ea8-8e19-e712b3507ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:42.476817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1ff1e-9674-4ea8-8e19-e712b3507ffb None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:42.484454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 455/901] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:38:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:42.490838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6cde-fc70-41a7-b344-b9d085b9503d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:42.582613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:42.586557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6cde-fc70-41a7-b344-b9d085b9503d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:42.620218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418930c-0b15-4a1d-8a39-21bb2e97f40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:42.620838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418930c-0b15-4a1d-8a39-21bb2e97f40b None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:42.621118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418930c-0b15-4a1d-8a39-21bb2e97f40b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:42.621392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418930c-0b15-4a1d-8a39-21bb2e97f40b None admin] PATH_INFO: `/v3/users/28ac44ee27f74cf895d6ce23ae65b4cb` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:42.622500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418930c-0b15-4a1d-8a39-21bb2e97f40b None admin] RBAC: Authorizing `identity:get_user(user_id=28ac44ee27f74cf895d6ce23ae65b4cb)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:42.623955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418930c-0b15-4a1d-8a39-21bb2e97f40b None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:42.626050 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 447/902] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Oct 12 04:38:42 2022] GET /identity/v3/users/28ac44ee27f74cf895d6ce23ae65b4cb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:42.631877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1ff1e-9674-4ea8-8e19-e712b3507ffb None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:42.727446 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1ff1e-9674-4ea8-8e19-e712b3507ffb None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:42.740696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:42.760564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83377ade-8bdb-4b94-92ff-19fcc3b57b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:42.761166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83377ade-8bdb-4b94-92ff-19fcc3b57b7d None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:42.761455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83377ade-8bdb-4b94-92ff-19fcc3b57b7d None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:42.761727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83377ade-8bdb-4b94-92ff-19fcc3b57b7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:42.824961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83377ade-8bdb-4b94-92ff-19fcc3b57b7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:42.826388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83377ade-8bdb-4b94-92ff-19fcc3b57b7d None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:42.918299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 456/903] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:38:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:38:42.924675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418930c-0b15-4a1d-8a39-21bb2e97f40b None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:43.019833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418930c-0b15-4a1d-8a39-21bb2e97f40b None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:43.052166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e528ca-93fb-47c9-8d9a-6cdefd0cc51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:43.052799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e528ca-93fb-47c9-8d9a-6cdefd0cc51c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:43.053075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e528ca-93fb-47c9-8d9a-6cdefd0cc51c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:43.053344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e528ca-93fb-47c9-8d9a-6cdefd0cc51c None admin] PATH_INFO: `/v3/projects/46f6b955153947358d899e7532918d5f` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:43.054432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e528ca-93fb-47c9-8d9a-6cdefd0cc51c None admin] RBAC: Authorizing `identity:get_project(project_id=46f6b955153947358d899e7532918d5f)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:43.055865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e528ca-93fb-47c9-8d9a-6cdefd0cc51c None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:43.057413 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 448/904] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Oct 12 04:38:42 2022] GET /identity/v3/projects/46f6b955153947358d899e7532918d5f => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:43.063829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83377ade-8bdb-4b94-92ff-19fcc3b57b7d None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:38:43.078698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:43.159234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83377ade-8bdb-4b94-92ff-19fcc3b57b7d None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:38:43.191732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d17f02-d3bc-4407-81c3-3e978b4db1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:38:43.192318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d17f02-d3bc-4407-81c3-3e978b4db1aa None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:38:43.192595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d17f02-d3bc-4407-81c3-3e978b4db1aa None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:38:43.192867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d17f02-d3bc-4407-81c3-3e978b4db1aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:38:43.193565 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d17f02-d3bc-4407-81c3-3e978b4db1aa None admin] RBAC: Adding query filter params (role.id=3d2307e73cdb4f6291f9735ac9359702, scope.project.id=46f6b955153947358d899e7532918d5f, user.id=28ac44ee27f74cf895d6ce23ae65b4cb) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:38:43.193869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d17f02-d3bc-4407-81c3-3e978b4db1aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:38:43.195265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d17f02-d3bc-4407-81c3-3e978b4db1aa None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:38:43.200763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 457/905] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:38:43 2022] GET /identity/v3/role_assignments?user.id=28ac44ee27f74cf895d6ce23ae65b4cb&scope.project.id=46f6b955153947358d899e7532918d5f&role.id=3d2307e73cdb4f6291f9735ac9359702 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:38:53.048128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=83 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:38:53.198328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=61 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:38.187510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39385807-cea4-4196-88da-0cd2331655c7 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:38.188209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39385807-cea4-4196-88da-0cd2331655c7 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:38.188209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39385807-cea4-4196-88da-0cd2331655c7 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:38.189552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 449/906] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:39:38.195853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b4412-5f1d-4c2e-a020-0f7f678e035d None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:38.196425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b4412-5f1d-4c2e-a020-0f7f678e035d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:38.196529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b4412-5f1d-4c2e-a020-0f7f678e035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:38.223969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-e65b4412-5f1d-4c2e-a020-0f7f678e035d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:39:38.225558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e65b4412-5f1d-4c2e-a020-0f7f678e035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:39:38.327137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 458/907] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:39:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:39:38.602285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39385807-cea4-4196-88da-0cd2331655c7 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:38.734633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39385807-cea4-4196-88da-0cd2331655c7 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:38.780363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b2f44-31d1-456d-bbf1-195b4a38b0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:38.781075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b2f44-31d1-456d-bbf1-195b4a38b0f5 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:38.781353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b2f44-31d1-456d-bbf1-195b4a38b0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:38.781685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b2f44-31d1-456d-bbf1-195b4a38b0f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:38.794149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b2f44-31d1-456d-bbf1-195b4a38b0f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:38.796285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b2f44-31d1-456d-bbf1-195b4a38b0f5 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-507b2f44-31d1-456d-bbf1-195b4a38b0f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:39:38.812874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:38.813947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:39:38.815169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:39:38.815169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:38.815169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:38.815169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 450/908] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:38.822259 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b4412-5f1d-4c2e-a020-0f7f678e035d None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:38.954499 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b4412-5f1d-4c2e-a020-0f7f678e035d None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:38.992308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:39.001321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b482e-a4f4-436c-b8c9-356856be7704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:39.002062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b482e-a4f4-436c-b8c9-356856be7704 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:39.002383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b482e-a4f4-436c-b8c9-356856be7704 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:39.002656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b482e-a4f4-436c-b8c9-356856be7704 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:39.003332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b482e-a4f4-436c-b8c9-356856be7704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:39.003629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b482e-a4f4-436c-b8c9-356856be7704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:39.004990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b482e-a4f4-436c-b8c9-356856be7704 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:39.021997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 459/909] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:39.026650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b2f44-31d1-456d-bbf1-195b4a38b0f5 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:39.105260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:39.166383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b2f44-31d1-456d-bbf1-195b4a38b0f5 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:39.208476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29a701-2b31-4b36-bf06-9bfc66c05eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:39.209524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29a701-2b31-4b36-bf06-9bfc66c05eae None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:39.209900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29a701-2b31-4b36-bf06-9bfc66c05eae None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:39.210157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29a701-2b31-4b36-bf06-9bfc66c05eae None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:39.211033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29a701-2b31-4b36-bf06-9bfc66c05eae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:39.213056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29a701-2b31-4b36-bf06-9bfc66c05eae None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:39.239853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 451/910] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Oct 12 04:39:39 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:39:41.495023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cade924-b2c9-4525-ad7a-b03648192b4b None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:41.495601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cade924-b2c9-4525-ad7a-b03648192b4b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:41.495691 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cade924-b2c9-4525-ad7a-b03648192b4b None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:41.497661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 460/911] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:39:41.503325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f3350-b2a6-4b3c-88fb-de5ef1c7cc06 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:41.504826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f3350-b2a6-4b3c-88fb-de5ef1c7cc06 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:41.504826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f3350-b2a6-4b3c-88fb-de5ef1c7cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:41.523995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-769f3350-b2a6-4b3c-88fb-de5ef1c7cc06 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:39:41.525722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-769f3350-b2a6-4b3c-88fb-de5ef1c7cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:39:41.615340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 452/912] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:39:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:39:41.874855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cade924-b2c9-4525-ad7a-b03648192b4b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:41.995989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cade924-b2c9-4525-ad7a-b03648192b4b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:42.039341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a496250-440d-4793-8a8f-ce210c319e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:42.040465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496250-440d-4793-8a8f-ce210c319e05 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:42.040465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496250-440d-4793-8a8f-ce210c319e05 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:42.040650 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496250-440d-4793-8a8f-ce210c319e05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:42.052486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a496250-440d-4793-8a8f-ce210c319e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-4a496250-440d-4793-8a8f-ce210c319e05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:39:42.057637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:42.060566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:39:42.061625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 461/913] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:42.065282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f3350-b2a6-4b3c-88fb-de5ef1c7cc06 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:42.114808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:42.185746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f3350-b2a6-4b3c-88fb-de5ef1c7cc06 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:42.224727 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ba08d-f53e-4b8f-ab4b-479294ff7a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:42.225381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ba08d-f53e-4b8f-ab4b-479294ff7a98 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:42.225636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ba08d-f53e-4b8f-ab4b-479294ff7a98 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:42.225970 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ba08d-f53e-4b8f-ab4b-479294ff7a98 None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:42.226727 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ba08d-f53e-4b8f-ab4b-479294ff7a98 None admin] RBAC: Adding query filter params (name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:42.227055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ba08d-f53e-4b8f-ab4b-479294ff7a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:42.228463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ba08d-f53e-4b8f-ab4b-479294ff7a98 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:42.238643 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 453/914] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:39:42.245049 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a496250-440d-4793-8a8f-ce210c319e05 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:42.304848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:42.362073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a496250-440d-4793-8a8f-ce210c319e05 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:42.406066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dfb43-6dc2-4e8a-bef0-0d5512016632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:42.407502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dfb43-6dc2-4e8a-bef0-0d5512016632 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:42.407502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dfb43-6dc2-4e8a-bef0-0d5512016632 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:42.407502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dfb43-6dc2-4e8a-bef0-0d5512016632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:42.419101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dfb43-6dc2-4e8a-bef0-0d5512016632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:42.421105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dfb43-6dc2-4e8a-bef0-0d5512016632 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-454dfb43-6dc2-4e8a-bef0-0d5512016632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:39:42.438502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:42.439675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:39:42.441135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:39:42.441135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:42.441135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:39:42.444570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 462/915] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:42.446272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ba08d-f53e-4b8f-ab4b-479294ff7a98 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:42.565237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:42.569328 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ba08d-f53e-4b8f-ab4b-479294ff7a98 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:42.614023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37ad72-050e-4504-b8b9-3428ba537922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:42.614023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37ad72-050e-4504-b8b9-3428ba537922 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:42.614477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37ad72-050e-4504-b8b9-3428ba537922 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:42.614904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37ad72-050e-4504-b8b9-3428ba537922 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:42.615763 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37ad72-050e-4504-b8b9-3428ba537922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:42.616067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37ad72-050e-4504-b8b9-3428ba537922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:42.617574 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37ad72-050e-4504-b8b9-3428ba537922 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:42.632957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 454/916] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:39:42.640029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dfb43-6dc2-4e8a-bef0-0d5512016632 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:42.766458 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dfb43-6dc2-4e8a-bef0-0d5512016632 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:42.768187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:42.802085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27e85b-5466-4f47-96a7-b26efc1b9018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:42.802649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27e85b-5466-4f47-96a7-b26efc1b9018 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:42.802934 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27e85b-5466-4f47-96a7-b26efc1b9018 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:42.803198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27e85b-5466-4f47-96a7-b26efc1b9018 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:42.810508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27e85b-5466-4f47-96a7-b26efc1b9018 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:42.811970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27e85b-5466-4f47-96a7-b26efc1b9018 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-3a27e85b-5466-4f47-96a7-b26efc1b9018 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:39:42.823672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:42.825245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:39:42.826220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 463/917] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:42.831013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37ad72-050e-4504-b8b9-3428ba537922 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:42.937237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37ad72-050e-4504-b8b9-3428ba537922 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:42.972272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc70eb5-6d59-45bb-b44a-c3471f657226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:42.972854 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc70eb5-6d59-45bb-b44a-c3471f657226 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:42.973134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc70eb5-6d59-45bb-b44a-c3471f657226 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:42.973424 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc70eb5-6d59-45bb-b44a-c3471f657226 None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:42.974122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc70eb5-6d59-45bb-b44a-c3471f657226 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:42.974671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc70eb5-6d59-45bb-b44a-c3471f657226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:42.976171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc70eb5-6d59-45bb-b44a-c3471f657226 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:42.995633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 455/918] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Oct 12 04:39:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:43.002033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27e85b-5466-4f47-96a7-b26efc1b9018 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:43.109397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27e85b-5466-4f47-96a7-b26efc1b9018 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:43.146348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e293dcb-4f56-48a0-801c-b20b6f79878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:43.147036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e293dcb-4f56-48a0-801c-b20b6f79878f None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:43.147351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e293dcb-4f56-48a0-801c-b20b6f79878f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:43.147654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e293dcb-4f56-48a0-801c-b20b6f79878f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:43.159913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e293dcb-4f56-48a0-801c-b20b6f79878f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:43.161546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e293dcb-4f56-48a0-801c-b20b6f79878f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-4e293dcb-4f56-48a0-801c-b20b6f79878f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:39:43.177095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:43.178188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:39:43.179262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:39:43.179262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:43.179262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:39:43.184919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 464/919] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:43.185065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc70eb5-6d59-45bb-b44a-c3471f657226 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:43.204493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:43.292144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc70eb5-6d59-45bb-b44a-c3471f657226 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:43.331562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e8f52-9579-450b-978c-5f145cf294c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:43.332180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8f52-9579-450b-978c-5f145cf294c5 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:43.332466 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8f52-9579-450b-978c-5f145cf294c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:43.332739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8f52-9579-450b-978c-5f145cf294c5 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:43.333391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e8f52-9579-450b-978c-5f145cf294c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:43.333682 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e8f52-9579-450b-978c-5f145cf294c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:43.335085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e8f52-9579-450b-978c-5f145cf294c5 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:43.348264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 456/920] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:43.354042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e293dcb-4f56-48a0-801c-b20b6f79878f None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:43.372249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:43.469154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e293dcb-4f56-48a0-801c-b20b6f79878f None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:43.508506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cff34-1dcb-49eb-bc90-53600fe41c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:43.509203 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cff34-1dcb-49eb-bc90-53600fe41c81 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:43.509485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cff34-1dcb-49eb-bc90-53600fe41c81 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:43.509767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cff34-1dcb-49eb-bc90-53600fe41c81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:43.518147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cff34-1dcb-49eb-bc90-53600fe41c81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:43.519810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cff34-1dcb-49eb-bc90-53600fe41c81 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-cf4cff34-1dcb-49eb-bc90-53600fe41c81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:39:43.532053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:43.533419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:43.534442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:39:43.534442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:39:43.534442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:39:43.534442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:39:43.534442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:39:43.534442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:39:43.534442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:39:43.534442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:39:43.534442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 465/921] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:43.539584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e8f52-9579-450b-978c-5f145cf294c5 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:43.637957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:43.662233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e8f52-9579-450b-978c-5f145cf294c5 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:43.702884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f6cbf-3d60-44a1-89f3-eeb4694953f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:43.703527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6cbf-3d60-44a1-89f3-eeb4694953f4 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:43.703810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6cbf-3d60-44a1-89f3-eeb4694953f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:43.704081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6cbf-3d60-44a1-89f3-eeb4694953f4 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:43.704798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f6cbf-3d60-44a1-89f3-eeb4694953f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:43.705100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f6cbf-3d60-44a1-89f3-eeb4694953f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:43.706585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f6cbf-3d60-44a1-89f3-eeb4694953f4 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:43.720787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 457/922] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:43.727918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cff34-1dcb-49eb-bc90-53600fe41c81 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:43.832237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:43.858431 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cff34-1dcb-49eb-bc90-53600fe41c81 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:43.893520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41391f-0847-45e6-b6c2-22495933acaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:43.894114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41391f-0847-45e6-b6c2-22495933acaa None admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:43.894396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41391f-0847-45e6-b6c2-22495933acaa None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:43.894672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41391f-0847-45e6-b6c2-22495933acaa None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/332a44161d204223983ed2aa3aef9317/roles/bb0934f87e1f44729e10e428242ea249` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:43.910444 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41391f-0847-45e6-b6c2-22495933acaa None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=332a44161d204223983ed2aa3aef9317, role_id=bb0934f87e1f44729e10e428242ea249)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:43.911948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41391f-0847-45e6-b6c2-22495933acaa None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:43.924218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 466/923] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:39:43 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/332a44161d204223983ed2aa3aef9317/roles/bb0934f87e1f44729e10e428242ea249 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:39:46.127045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2993171-516d-4a22-9768-8cd915e7f8a2 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:46.127638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2993171-516d-4a22-9768-8cd915e7f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:46.127638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2993171-516d-4a22-9768-8cd915e7f8a2 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:46.128933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 458/924] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:39:46.134099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0ceda-2a68-4f83-8422-cb51f024ea14 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:46.134598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0ceda-2a68-4f83-8422-cb51f024ea14 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:46.134694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0ceda-2a68-4f83-8422-cb51f024ea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:46.153506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-73b0ceda-2a68-4f83-8422-cb51f024ea14 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:39:46.154674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-73b0ceda-2a68-4f83-8422-cb51f024ea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:39:46.223796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 467/925] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:39:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:39:46.492127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2993171-516d-4a22-9768-8cd915e7f8a2 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:46.603753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2993171-516d-4a22-9768-8cd915e7f8a2 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:46.642076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061e92-0c51-444e-8cdb-b4c154c30a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:46.642775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061e92-0c51-444e-8cdb-b4c154c30a1f None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:46.643058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061e92-0c51-444e-8cdb-b4c154c30a1f None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:46.643394 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061e92-0c51-444e-8cdb-b4c154c30a1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:46.652053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:46.657148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e061e92-0c51-444e-8cdb-b4c154c30a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-5e061e92-0c51-444e-8cdb-b4c154c30a1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:39:46.663217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:46.664153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:46.665004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 459/926] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Oct 12 04:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:46.672126 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0ceda-2a68-4f83-8422-cb51f024ea14 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:46.734941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:46.784282 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0ceda-2a68-4f83-8422-cb51f024ea14 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:46.820425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26171cbc-f59b-48e3-a388-4ce4d0f5d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:46.821085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171cbc-f59b-48e3-a388-4ce4d0f5d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:46.821370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171cbc-f59b-48e3-a388-4ce4d0f5d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:46.821648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171cbc-f59b-48e3-a388-4ce4d0f5d0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:46.822387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26171cbc-f59b-48e3-a388-4ce4d0f5d0c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:46.822696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26171cbc-f59b-48e3-a388-4ce4d0f5d0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:46.824129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26171cbc-f59b-48e3-a388-4ce4d0f5d0c6 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:46.832634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 468/927] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Oct 12 04:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:46.839033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061e92-0c51-444e-8cdb-b4c154c30a1f None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:46.949997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061e92-0c51-444e-8cdb-b4c154c30a1f None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:46.988728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df8bdd-0312-4065-abe8-92d40207bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:46.989364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df8bdd-0312-4065-abe8-92d40207bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:46.989649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df8bdd-0312-4065-abe8-92d40207bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:46.989926 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df8bdd-0312-4065-abe8-92d40207bbf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:47.000232 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df8bdd-0312-4065-abe8-92d40207bbf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:47.001684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df8bdd-0312-4065-abe8-92d40207bbf2 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-91df8bdd-0312-4065-abe8-92d40207bbf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:39:47.017747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:47.018788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:39:47.019786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:39:47.019786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:47.019786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:47.019786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 460/928] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:47.025177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26171cbc-f59b-48e3-a388-4ce4d0f5d0c6 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:47.136497 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26171cbc-f59b-48e3-a388-4ce4d0f5d0c6 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:47.153227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:47.172723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87bb34-fbb1-4477-a3d8-7341cfc0eaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:47.173336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87bb34-fbb1-4477-a3d8-7341cfc0eaa5 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:47.173619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87bb34-fbb1-4477-a3d8-7341cfc0eaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:47.173896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87bb34-fbb1-4477-a3d8-7341cfc0eaa5 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:47.174529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87bb34-fbb1-4477-a3d8-7341cfc0eaa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:47.174835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87bb34-fbb1-4477-a3d8-7341cfc0eaa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:47.176235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87bb34-fbb1-4477-a3d8-7341cfc0eaa5 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:47.189190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 469/929] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:47.195363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df8bdd-0312-4065-abe8-92d40207bbf2 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:47.249991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:47.307241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df8bdd-0312-4065-abe8-92d40207bbf2 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:47.346467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83b33f-5176-46c4-bc2e-02b85dda5685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:47.347102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83b33f-5176-46c4-bc2e-02b85dda5685 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:47.348396 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83b33f-5176-46c4-bc2e-02b85dda5685 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:47.348396 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83b33f-5176-46c4-bc2e-02b85dda5685 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:47.355309 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83b33f-5176-46c4-bc2e-02b85dda5685 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:47.356886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83b33f-5176-46c4-bc2e-02b85dda5685 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-bd83b33f-5176-46c4-bc2e-02b85dda5685 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:39:47.369496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:47.370533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:47.371595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 461/930] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:47.376879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87bb34-fbb1-4477-a3d8-7341cfc0eaa5 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:47.490511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87bb34-fbb1-4477-a3d8-7341cfc0eaa5 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:47.525785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14ad6d-0590-4089-ba3b-a9e6e16fd74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:47.526392 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14ad6d-0590-4089-ba3b-a9e6e16fd74f None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:47.526669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14ad6d-0590-4089-ba3b-a9e6e16fd74f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:47.526942 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14ad6d-0590-4089-ba3b-a9e6e16fd74f None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:47.528234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14ad6d-0590-4089-ba3b-a9e6e16fd74f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:47.528649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14ad6d-0590-4089-ba3b-a9e6e16fd74f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:47.530405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14ad6d-0590-4089-ba3b-a9e6e16fd74f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:47.550626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 470/931] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Oct 12 04:39:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:47.558019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83b33f-5176-46c4-bc2e-02b85dda5685 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:47.668469 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83b33f-5176-46c4-bc2e-02b85dda5685 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:47.680052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:47.707479 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844419a5-99d1-4d5b-9d1b-40a4bd10414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:47.708091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844419a5-99d1-4d5b-9d1b-40a4bd10414e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:47.708376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844419a5-99d1-4d5b-9d1b-40a4bd10414e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:47.708653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844419a5-99d1-4d5b-9d1b-40a4bd10414e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:47.777902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844419a5-99d1-4d5b-9d1b-40a4bd10414e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:47.779302 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844419a5-99d1-4d5b-9d1b-40a4bd10414e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:47.889116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 462/932] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:39:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:39:47.895012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14ad6d-0590-4089-ba3b-a9e6e16fd74f None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:47.932455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:48.009338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14ad6d-0590-4089-ba3b-a9e6e16fd74f None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:48.044093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f654-1b15-4774-ad4e-eef4b56fbec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:48.044743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f654-1b15-4774-ad4e-eef4b56fbec8 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:48.045025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f654-1b15-4774-ad4e-eef4b56fbec8 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:48.045341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f654-1b15-4774-ad4e-eef4b56fbec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:48.056219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495f654-1b15-4774-ad4e-eef4b56fbec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:48.057739 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495f654-1b15-4774-ad4e-eef4b56fbec8 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-6495f654-1b15-4774-ad4e-eef4b56fbec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:39:48.074447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:48.075675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:39:48.076721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:39:48.076721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:48.076721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:39:48.076721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 471/933] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:39:48.083156 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844419a5-99d1-4d5b-9d1b-40a4bd10414e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:48.095420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:48.186550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844419a5-99d1-4d5b-9d1b-40a4bd10414e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:48.222233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda5935-7c3a-437b-a7fa-8aac95bd5941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:48.222850 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda5935-7c3a-437b-a7fa-8aac95bd5941 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:48.223141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda5935-7c3a-437b-a7fa-8aac95bd5941 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:48.223417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda5935-7c3a-437b-a7fa-8aac95bd5941 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:48.224102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda5935-7c3a-437b-a7fa-8aac95bd5941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:48.224405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda5935-7c3a-437b-a7fa-8aac95bd5941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:48.225928 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda5935-7c3a-437b-a7fa-8aac95bd5941 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:48.238313 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 463/934] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:48.244653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f654-1b15-4774-ad4e-eef4b56fbec8 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:48.338825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:48.355812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f654-1b15-4774-ad4e-eef4b56fbec8 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:48.392456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730e6e4-5093-4944-b748-fad575a95fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:48.393099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730e6e4-5093-4944-b748-fad575a95fb7 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:48.393379 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730e6e4-5093-4944-b748-fad575a95fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:48.393658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730e6e4-5093-4944-b748-fad575a95fb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:48.401062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730e6e4-5093-4944-b748-fad575a95fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:48.403199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730e6e4-5093-4944-b748-fad575a95fb7 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-c730e6e4-5093-4944-b748-fad575a95fb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:39:48.415672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:48.416747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:48.422541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:39:48.422541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:39:48.422541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:39:48.422541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:39:48.422541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:39:48.422541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:39:48.422541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:39:48.422541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:39:48.422541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 472/935] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:48.423421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda5935-7c3a-437b-a7fa-8aac95bd5941 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:48.498134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:48.535422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda5935-7c3a-437b-a7fa-8aac95bd5941 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:48.569933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6ae47-edde-4d58-a16a-46448ccf6d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:48.570543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ae47-edde-4d58-a16a-46448ccf6d79 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:48.570828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ae47-edde-4d58-a16a-46448ccf6d79 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:48.571104 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ae47-edde-4d58-a16a-46448ccf6d79 None admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:48.571831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6ae47-edde-4d58-a16a-46448ccf6d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:48.572143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6ae47-edde-4d58-a16a-46448ccf6d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:48.573583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6ae47-edde-4d58-a16a-46448ccf6d79 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:48.589378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 464/936] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:48.595442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730e6e4-5093-4944-b748-fad575a95fb7 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:48.699669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730e6e4-5093-4944-b748-fad575a95fb7 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:48.734785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050e49-c9f5-4f31-bae3-c7399efa5f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:48.735498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050e49-c9f5-4f31-bae3-c7399efa5f88 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:48.735788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050e49-c9f5-4f31-bae3-c7399efa5f88 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:48.736069 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050e49-c9f5-4f31-bae3-c7399efa5f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:48.736863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050e49-c9f5-4f31-bae3-c7399efa5f88 None admin] RBAC: Adding query filter params (role.id=bb0934f87e1f44729e10e428242ea249, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=332a44161d204223983ed2aa3aef9317) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:48.737163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050e49-c9f5-4f31-bae3-c7399efa5f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:48.738581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050e49-c9f5-4f31-bae3-c7399efa5f88 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:48.745450 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 473/937] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:39:48 2022] GET /identity/v3/role_assignments?user.id=332a44161d204223983ed2aa3aef9317&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=bb0934f87e1f44729e10e428242ea249 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:51.068502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c11004-8c8a-464c-98c7-b1f000b1730c None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:51.069090 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c11004-8c8a-464c-98c7-b1f000b1730c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:51.069090 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c11004-8c8a-464c-98c7-b1f000b1730c None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:51.070543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 465/938] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:39:51.076205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceec9d-ac01-40df-8e5d-88342d8fdde4 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:51.076711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceec9d-ac01-40df-8e5d-88342d8fdde4 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:51.076850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceec9d-ac01-40df-8e5d-88342d8fdde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:51.098501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c3ceec9d-ac01-40df-8e5d-88342d8fdde4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:39:51.099825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c3ceec9d-ac01-40df-8e5d-88342d8fdde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:39:51.103107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:51.174789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 474/939] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:39:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:39:51.446574 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c11004-8c8a-464c-98c7-b1f000b1730c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:51.548930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c11004-8c8a-464c-98c7-b1f000b1730c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:51.580469 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:51.587024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044b0fb-9ad4-4f34-9219-d2e3d8918a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:51.587708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b0fb-9ad4-4f34-9219-d2e3d8918a9c None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:51.587972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b0fb-9ad4-4f34-9219-d2e3d8918a9c None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:51.588243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b0fb-9ad4-4f34-9219-d2e3d8918a9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:51.598778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044b0fb-9ad4-4f34-9219-d2e3d8918a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-3044b0fb-9ad4-4f34-9219-d2e3d8918a9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:39:51.603588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:51.604540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:51.605980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 466/940] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:39:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:51.613169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ceec9d-ac01-40df-8e5d-88342d8fdde4 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:51.714261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ceec9d-ac01-40df-8e5d-88342d8fdde4 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:51.750209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32d524-077b-4800-a1e9-286ec314f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:51.750815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32d524-077b-4800-a1e9-286ec314f4c2 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:51.751103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32d524-077b-4800-a1e9-286ec314f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:51.751420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32d524-077b-4800-a1e9-286ec314f4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:51.752081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32d524-077b-4800-a1e9-286ec314f4c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:51.752387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32d524-077b-4800-a1e9-286ec314f4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:51.753766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32d524-077b-4800-a1e9-286ec314f4c2 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:51.762539 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 475/941] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:39:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:51.768301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044b0fb-9ad4-4f34-9219-d2e3d8918a9c None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:51.877628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044b0fb-9ad4-4f34-9219-d2e3d8918a9c None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:51.916640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848c173-2148-4ce8-877a-34fa7f0a76f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:51.917273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848c173-2148-4ce8-877a-34fa7f0a76f3 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:51.917778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848c173-2148-4ce8-877a-34fa7f0a76f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:51.917896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848c173-2148-4ce8-877a-34fa7f0a76f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:51.930597 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848c173-2148-4ce8-877a-34fa7f0a76f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:51.932190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848c173-2148-4ce8-877a-34fa7f0a76f3 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-3848c173-2148-4ce8-877a-34fa7f0a76f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:39:51.949693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:51.950756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:39:51.951723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:39:51.951723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:51.951723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:51.951723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 467/942] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:39:51.956635 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32d524-077b-4800-a1e9-286ec314f4c2 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:51.960651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:52.069334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32d524-077b-4800-a1e9-286ec314f4c2 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:52.104242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5b610-98b0-4ee2-9909-2603101a7dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:52.104894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b610-98b0-4ee2-9909-2603101a7dd9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:52.105241 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b610-98b0-4ee2-9909-2603101a7dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:52.105429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b610-98b0-4ee2-9909-2603101a7dd9 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:52.106065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5b610-98b0-4ee2-9909-2603101a7dd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:52.106365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5b610-98b0-4ee2-9909-2603101a7dd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:52.107807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5b610-98b0-4ee2-9909-2603101a7dd9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:52.120386 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 476/943] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:52.126793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848c173-2148-4ce8-877a-34fa7f0a76f3 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:52.172785 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:52.236633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848c173-2148-4ce8-877a-34fa7f0a76f3 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:52.274719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d867-1aa5-461f-92e1-9b405a3a0291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:52.275406 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d867-1aa5-461f-92e1-9b405a3a0291 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:52.275648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d867-1aa5-461f-92e1-9b405a3a0291 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:52.275943 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012d867-1aa5-461f-92e1-9b405a3a0291 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:52.284490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012d867-1aa5-461f-92e1-9b405a3a0291 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:52.285966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012d867-1aa5-461f-92e1-9b405a3a0291 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-f012d867-1aa5-461f-92e1-9b405a3a0291 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:39:52.298810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:52.299859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:52.300779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 468/944] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:52.306005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5b610-98b0-4ee2-9909-2603101a7dd9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:52.373247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:52.413402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5b610-98b0-4ee2-9909-2603101a7dd9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:52.447542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc652c0-5e39-4478-93eb-79cd8586b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:52.448150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc652c0-5e39-4478-93eb-79cd8586b3b1 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:52.448432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc652c0-5e39-4478-93eb-79cd8586b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:52.448737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc652c0-5e39-4478-93eb-79cd8586b3b1 None admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:52.450000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc652c0-5e39-4478-93eb-79cd8586b3b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:52.450307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc652c0-5e39-4478-93eb-79cd8586b3b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:52.451782 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc652c0-5e39-4478-93eb-79cd8586b3b1 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:52.470153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 477/945] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Oct 12 04:39:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:52.475931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d867-1aa5-461f-92e1-9b405a3a0291 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:52.588032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012d867-1aa5-461f-92e1-9b405a3a0291 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:52.589778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:52.631082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bf9ff-339b-4ade-bb27-a8ea9343ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:52.631757 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bf9ff-339b-4ade-bb27-a8ea9343ebbb None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:52.632033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bf9ff-339b-4ade-bb27-a8ea9343ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:52.632300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bf9ff-339b-4ade-bb27-a8ea9343ebbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:52.644436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bf9ff-339b-4ade-bb27-a8ea9343ebbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:52.646140 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bf9ff-339b-4ade-bb27-a8ea9343ebbb None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-f49bf9ff-339b-4ade-bb27-a8ea9343ebbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:39:52.664297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:52.665343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:39:52.666237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:39:52.666237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:52.666237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:52.666237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 469/946] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:52.671302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc652c0-5e39-4478-93eb-79cd8586b3b1 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:52.781401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc652c0-5e39-4478-93eb-79cd8586b3b1 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:52.801572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:52.818804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd162a-c0f9-481c-908b-f5dc82828484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:52.819551 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd162a-c0f9-481c-908b-f5dc82828484 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:52.819906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd162a-c0f9-481c-908b-f5dc82828484 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:52.820284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd162a-c0f9-481c-908b-f5dc82828484 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:52.820997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd162a-c0f9-481c-908b-f5dc82828484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:52.821313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd162a-c0f9-481c-908b-f5dc82828484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:52.822794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd162a-c0f9-481c-908b-f5dc82828484 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:52.835192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 478/947] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:52.841393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bf9ff-339b-4ade-bb27-a8ea9343ebbb None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:52.957602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bf9ff-339b-4ade-bb27-a8ea9343ebbb None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:52.992176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e7d18-10ab-4969-bd3d-b62f03f37a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:52.992822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e7d18-10ab-4969-bd3d-b62f03f37a7e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:52.993141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e7d18-10ab-4969-bd3d-b62f03f37a7e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:52.993424 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e7d18-10ab-4969-bd3d-b62f03f37a7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:53.002305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e7d18-10ab-4969-bd3d-b62f03f37a7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:53.003824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e7d18-10ab-4969-bd3d-b62f03f37a7e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-d50e7d18-10ab-4969-bd3d-b62f03f37a7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:39:53.017554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:53.019760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:53.020645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:39:53.020645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:39:53.020645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:39:53.020645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:39:53.020645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:39:53.020645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:39:53.020645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:39:53.020645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:53.020645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 470/948] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 04:39:53.025012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd162a-c0f9-481c-908b-f5dc82828484 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:53.135120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd162a-c0f9-481c-908b-f5dc82828484 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:53.169699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f01451-3db5-4f68-847e-607eb8630929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:53.170396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f01451-3db5-4f68-847e-607eb8630929 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:53.170679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f01451-3db5-4f68-847e-607eb8630929 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:53.170961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f01451-3db5-4f68-847e-607eb8630929 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:53.171689 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f01451-3db5-4f68-847e-607eb8630929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:53.172011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f01451-3db5-4f68-847e-607eb8630929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:53.173404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f01451-3db5-4f68-847e-607eb8630929 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:53.185880 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 479/949] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:53.192582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e7d18-10ab-4969-bd3d-b62f03f37a7e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:53.210659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:53.314322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e7d18-10ab-4969-bd3d-b62f03f37a7e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:53.354238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582230b2-7d2d-4bf5-a458-a966f22ab3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:53.355486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582230b2-7d2d-4bf5-a458-a966f22ab3a2 None admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:53.355774 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582230b2-7d2d-4bf5-a458-a966f22ab3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:53.356053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582230b2-7d2d-4bf5-a458-a966f22ab3a2 None admin] PATH_INFO: `/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/332a44161d204223983ed2aa3aef9317/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:53.358075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582230b2-7d2d-4bf5-a458-a966f22ab3a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ec61ba796824f7daa146d9ae5f03228, user_id=332a44161d204223983ed2aa3aef9317, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:53.359587 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582230b2-7d2d-4bf5-a458-a966f22ab3a2 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:53.373983 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 471/950] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Oct 12 04:39:53 2022] PUT /identity/v3/projects/4ec61ba796824f7daa146d9ae5f03228/users/332a44161d204223983ed2aa3aef9317/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:39:55.605558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628976f8-caa8-4333-9b21-ce35a17b4b71 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:55.606063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628976f8-caa8-4333-9b21-ce35a17b4b71 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:55.606154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628976f8-caa8-4333-9b21-ce35a17b4b71 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:55.607472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 480/951] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:39:55.612955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06618c90-ea97-4163-9758-b2b119c1fb6c None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:55.613434 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06618c90-ea97-4163-9758-b2b119c1fb6c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:55.613572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06618c90-ea97-4163-9758-b2b119c1fb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:55.632635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-06618c90-ea97-4163-9758-b2b119c1fb6c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:39:55.634071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-06618c90-ea97-4163-9758-b2b119c1fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:39:55.710267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 472/952] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:39:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:39:55.985224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628976f8-caa8-4333-9b21-ce35a17b4b71 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:56.031004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:56.096849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628976f8-caa8-4333-9b21-ce35a17b4b71 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:56.137439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b45ca-8c1c-4ef3-bed5-b5500ea8b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:56.138157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b45ca-8c1c-4ef3-bed5-b5500ea8b2ab None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:56.138510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b45ca-8c1c-4ef3-bed5-b5500ea8b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:56.138794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b45ca-8c1c-4ef3-bed5-b5500ea8b2ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:56.149631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b45ca-8c1c-4ef3-bed5-b5500ea8b2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-b27b45ca-8c1c-4ef3-bed5-b5500ea8b2ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 04:39:56.154487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:56.155628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:39:56.156510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 481/953] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Oct 12 04:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:56.162250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06618c90-ea97-4163-9758-b2b119c1fb6c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:56.166064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:56.269576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06618c90-ea97-4163-9758-b2b119c1fb6c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:56.310504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00043098-440e-4979-bd38-1a7c458b9e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:56.311234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043098-440e-4979-bd38-1a7c458b9e3d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:56.311603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043098-440e-4979-bd38-1a7c458b9e3d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:56.311949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043098-440e-4979-bd38-1a7c458b9e3d None admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:56.312689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00043098-440e-4979-bd38-1a7c458b9e3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:56.312999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00043098-440e-4979-bd38-1a7c458b9e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:56.314373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00043098-440e-4979-bd38-1a7c458b9e3d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:56.322385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 473/954] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Oct 12 04:39:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:39:56.328929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b45ca-8c1c-4ef3-bed5-b5500ea8b2ab None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:56.436056 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:56.439710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b45ca-8c1c-4ef3-bed5-b5500ea8b2ab None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:56.478386 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eaa26b-1068-4b7a-8a82-9101dc491f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:56.479146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaa26b-1068-4b7a-8a82-9101dc491f63 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:56.479606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaa26b-1068-4b7a-8a82-9101dc491f63 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:56.480062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaa26b-1068-4b7a-8a82-9101dc491f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:56.494127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eaa26b-1068-4b7a-8a82-9101dc491f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:56.496632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eaa26b-1068-4b7a-8a82-9101dc491f63 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-65eaa26b-1068-4b7a-8a82-9101dc491f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:39:56.512119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:56.513171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:39:56.514092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:39:56.514092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:56.514092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:39:56.514092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 482/955] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:56.519824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00043098-440e-4979-bd38-1a7c458b9e3d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:56.596136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:56.636862 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00043098-440e-4979-bd38-1a7c458b9e3d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:56.674405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11965283-70c0-45ce-be8c-4f66fb995235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:56.675013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11965283-70c0-45ce-be8c-4f66fb995235 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:56.675304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11965283-70c0-45ce-be8c-4f66fb995235 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:56.675589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11965283-70c0-45ce-be8c-4f66fb995235 None admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:56.676217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11965283-70c0-45ce-be8c-4f66fb995235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:56.676520 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11965283-70c0-45ce-be8c-4f66fb995235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:56.677945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11965283-70c0-45ce-be8c-4f66fb995235 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:56.692353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 474/956] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:39:56.698062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eaa26b-1068-4b7a-8a82-9101dc491f63 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:56.810007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eaa26b-1068-4b7a-8a82-9101dc491f63 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:56.845896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a5305-410d-4059-8358-20a5ef73f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:56.846546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a5305-410d-4059-8358-20a5ef73f7fd None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:56.846825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a5305-410d-4059-8358-20a5ef73f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:56.847100 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a5305-410d-4059-8358-20a5ef73f7fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:56.856085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a5305-410d-4059-8358-20a5ef73f7fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:56.857566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a5305-410d-4059-8358-20a5ef73f7fd None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-1e3a5305-410d-4059-8358-20a5ef73f7fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 04:39:56.869718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:56.871410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:39:56.872387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 483/957] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:56.877361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11965283-70c0-45ce-be8c-4f66fb995235 None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:56.981532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11965283-70c0-45ce-be8c-4f66fb995235 None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:57.008232 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:57.017276 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2ca70-6690-4aea-84d5-9f6dbc773f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:57.017894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ca70-6690-4aea-84d5-9f6dbc773f8e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:57.018173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ca70-6690-4aea-84d5-9f6dbc773f8e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:57.018441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2ca70-6690-4aea-84d5-9f6dbc773f8e None admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:57.019240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2ca70-6690-4aea-84d5-9f6dbc773f8e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:57.019576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2ca70-6690-4aea-84d5-9f6dbc773f8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:57.021012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2ca70-6690-4aea-84d5-9f6dbc773f8e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:57.045498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 475/958] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Oct 12 04:39:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:57.046833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a5305-410d-4059-8358-20a5ef73f7fd None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:57.063259 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:57.157598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a5305-410d-4059-8358-20a5ef73f7fd None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:57.192630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459f9e9-d57b-40b1-8d59-cfa5c4b34ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:57.193247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459f9e9-d57b-40b1-8d59-cfa5c4b34ac6 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:57.193526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459f9e9-d57b-40b1-8d59-cfa5c4b34ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:57.193803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459f9e9-d57b-40b1-8d59-cfa5c4b34ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:57.267734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459f9e9-d57b-40b1-8d59-cfa5c4b34ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:57.269716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459f9e9-d57b-40b1-8d59-cfa5c4b34ac6 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:57.288855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:57.374461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 484/959] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Oct 12 04:39:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 04:39:57.380266 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2ca70-6690-4aea-84d5-9f6dbc773f8e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:57.478975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2ca70-6690-4aea-84d5-9f6dbc773f8e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:57.511831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f7868-bf4f-47e4-8e6f-1c49320de00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:57.512452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7868-bf4f-47e4-8e6f-1c49320de00e None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:57.512731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7868-bf4f-47e4-8e6f-1c49320de00e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:57.513003 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7868-bf4f-47e4-8e6f-1c49320de00e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:57.522569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f7868-bf4f-47e4-8e6f-1c49320de00e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:57.524030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f7868-bf4f-47e4-8e6f-1c49320de00e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-f71f7868-bf4f-47e4-8e6f-1c49320de00e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 04:39:57.538684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:57.539840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 04:39:57.540762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 04:39:57.540762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 04:39:57.540762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:57.540762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 476/960] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:57.546026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459f9e9-d57b-40b1-8d59-cfa5c4b34ac6 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:57.642535 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459f9e9-d57b-40b1-8d59-cfa5c4b34ac6 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:57.656018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:57.676525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c91b-af38-420f-92a2-775fac5b2ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:57.677123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c91b-af38-420f-92a2-775fac5b2ae9 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:57.677405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c91b-af38-420f-92a2-775fac5b2ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:57.677681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c91b-af38-420f-92a2-775fac5b2ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:57.678307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88c91b-af38-420f-92a2-775fac5b2ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:57.678608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88c91b-af38-420f-92a2-775fac5b2ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:57.680000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88c91b-af38-420f-92a2-775fac5b2ae9 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:57.690742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 485/961] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Oct 12 04:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:57.696353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f7868-bf4f-47e4-8e6f-1c49320de00e None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:57.731929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:57.795108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f7868-bf4f-47e4-8e6f-1c49320de00e None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:57.827534 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442c0c8-b047-41c4-892a-644aeffb0e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:57.828148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c0c8-b047-41c4-892a-644aeffb0e7d None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:57.828431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c0c8-b047-41c4-892a-644aeffb0e7d None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:57.828708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c0c8-b047-41c4-892a-644aeffb0e7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:57.835117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442c0c8-b047-41c4-892a-644aeffb0e7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:57.836830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442c0c8-b047-41c4-892a-644aeffb0e7d None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application [None req-7442c0c8-b047-41c4-892a-644aeffb0e7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 04:39:57.848356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application with Lock( Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:39:57.849378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:39:57.850289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 04:39:57.850289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 04:39:57.850289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 04:39:57.850289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 04:39:57.850289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 04:39:57.850289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 04:39:57.850289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 04:39:57.850289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: ERROR keystone.server.flask.application Oct 12 04:39:57.850289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 477/962] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Oct 12 04:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:39:57.855292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c91b-af38-420f-92a2-775fac5b2ae9 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:57.951540 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c91b-af38-420f-92a2-775fac5b2ae9 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:57.983617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb559700-7b38-42ff-8cb1-0bc91744f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:57.984210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb559700-7b38-42ff-8cb1-0bc91744f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:57.984490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb559700-7b38-42ff-8cb1-0bc91744f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:57.984764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb559700-7b38-42ff-8cb1-0bc91744f4a0 None admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:57.985435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb559700-7b38-42ff-8cb1-0bc91744f4a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:57.985742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb559700-7b38-42ff-8cb1-0bc91744f4a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:57.987145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb559700-7b38-42ff-8cb1-0bc91744f4a0 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:57.998962 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 486/963] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Oct 12 04:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:39:58.004777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442c0c8-b047-41c4-892a-644aeffb0e7d None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:39:58.095013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:39:58.101033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442c0c8-b047-41c4-892a-644aeffb0e7d None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:39:58.133300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d11f50-bd58-4429-a20f-501ab8ef609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:39:58.133889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d11f50-bd58-4429-a20f-501ab8ef609b None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:39:58.134172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d11f50-bd58-4429-a20f-501ab8ef609b None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:39:58.134447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d11f50-bd58-4429-a20f-501ab8ef609b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:39:58.135160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d11f50-bd58-4429-a20f-501ab8ef609b None admin] RBAC: Adding query filter params (role.id=3d2307e73cdb4f6291f9735ac9359702, scope.project.id=4ec61ba796824f7daa146d9ae5f03228, user.id=332a44161d204223983ed2aa3aef9317) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:39:58.135497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d11f50-bd58-4429-a20f-501ab8ef609b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:39:58.136949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d11f50-bd58-4429-a20f-501ab8ef609b None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:39:58.142451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 478/964] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Oct 12 04:39:58 2022] GET /identity/v3/role_assignments?user.id=332a44161d204223983ed2aa3aef9317&scope.project.id=4ec61ba796824f7daa146d9ae5f03228&role.id=3d2307e73cdb4f6291f9735ac9359702 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:40:00.255102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54f95c-4e58-40b7-8ec8-5019b199acdb None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:00.255736 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54f95c-4e58-40b7-8ec8-5019b199acdb None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:00.256008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54f95c-4e58-40b7-8ec8-5019b199acdb None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:00.257902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 487/965] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:40:00.263811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c497ea-3ad5-4350-a002-fa3d0382eddc None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:00.264223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c497ea-3ad5-4350-a002-fa3d0382eddc None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:00.264450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c497ea-3ad5-4350-a002-fa3d0382eddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:00.284900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-95c497ea-3ad5-4350-a002-fa3d0382eddc None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:40:00.286244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-95c497ea-3ad5-4350-a002-fa3d0382eddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:40:00.358270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 479/966] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:40:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 04:40:00.626838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54f95c-4e58-40b7-8ec8-5019b199acdb None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:00.656553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:40:00.724683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54f95c-4e58-40b7-8ec8-5019b199acdb None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:00.757398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e464f6-fe8f-4117-8327-509689472419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:00.758020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e464f6-fe8f-4117-8327-509689472419 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:00.758300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e464f6-fe8f-4117-8327-509689472419 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:00.758572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e464f6-fe8f-4117-8327-509689472419 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:00.759138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e464f6-fe8f-4117-8327-509689472419 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:00.760523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e464f6-fe8f-4117-8327-509689472419 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-b1e464f6-fe8f-4117-8327-509689472419 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:40:00.769052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:40:00.770209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:40:00.771228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 488/967] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 04:40:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:40:00.776121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c497ea-3ad5-4350-a002-fa3d0382eddc None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:00.861468 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:40:00.871490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c497ea-3ad5-4350-a002-fa3d0382eddc None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:00.903129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9d34-842c-4355-8ce9-056a56261140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:00.903763 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9d34-842c-4355-8ce9-056a56261140 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:00.904046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9d34-842c-4355-8ce9-056a56261140 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:00.904320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9d34-842c-4355-8ce9-056a56261140 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:00.904942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9d34-842c-4355-8ce9-056a56261140 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:40:00.905250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9d34-842c-4355-8ce9-056a56261140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:00.906603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9d34-842c-4355-8ce9-056a56261140 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:00.911170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 480/968] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Oct 12 04:40:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:40:00.916757 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e464f6-fe8f-4117-8327-509689472419 None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:01.007875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:40:01.014050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e464f6-fe8f-4117-8327-509689472419 None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:01.046738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405912ef-3815-46f3-b38e-cc673a933eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:01.047353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405912ef-3815-46f3-b38e-cc673a933eb0 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:01.047639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405912ef-3815-46f3-b38e-cc673a933eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:01.047915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405912ef-3815-46f3-b38e-cc673a933eb0 None admin] PATH_INFO: `/v3/services` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:01.048528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405912ef-3815-46f3-b38e-cc673a933eb0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:40:01.048832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405912ef-3815-46f3-b38e-cc673a933eb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:01.050185 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405912ef-3815-46f3-b38e-cc673a933eb0 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:01.054445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 489/969] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Oct 12 04:40:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:40:03.156704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba806-97c6-4240-bb17-6dd07b744188 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:03.157292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba806-97c6-4240-bb17-6dd07b744188 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:03.157292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba806-97c6-4240-bb17-6dd07b744188 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:03.158556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 481/970] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:40:03.163959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f5ec-d9ad-4240-9183-fb8b9dc09651 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:03.164362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f5ec-d9ad-4240-9183-fb8b9dc09651 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:03.164511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529f5ec-d9ad-4240-9183-fb8b9dc09651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:03.182125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-5529f5ec-d9ad-4240-9183-fb8b9dc09651 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:40:03.183844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5529f5ec-d9ad-4240-9183-fb8b9dc09651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:40:03.247167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 490/971] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:40:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:40:03.511068 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ba806-97c6-4240-bb17-6dd07b744188 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:03.609243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ba806-97c6-4240-bb17-6dd07b744188 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:03.643023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942dc99-33b2-4cc8-a469-4b5443a4720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:03.643658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942dc99-33b2-4cc8-a469-4b5443a4720e None admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:03.643942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942dc99-33b2-4cc8-a469-4b5443a4720e None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:03.644220 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942dc99-33b2-4cc8-a469-4b5443a4720e None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:03.644865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942dc99-33b2-4cc8-a469-4b5443a4720e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:03.646220 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942dc99-33b2-4cc8-a469-4b5443a4720e None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:03.660320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 482/972] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Oct 12 04:40:03 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:40:05.779519 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53da71c-e5e6-451c-a277-22783de2b2ab None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:05.780066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53da71c-e5e6-451c-a277-22783de2b2ab None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:05.780066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53da71c-e5e6-451c-a277-22783de2b2ab None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:05.781409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 491/973] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:40:05.786626 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eee348-2b9d-43bb-aaf4-d3ac14372741 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:05.787055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eee348-2b9d-43bb-aaf4-d3ac14372741 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:05.787157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eee348-2b9d-43bb-aaf4-d3ac14372741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:05.805285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e4eee348-2b9d-43bb-aaf4-d3ac14372741 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:40:05.806450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e4eee348-2b9d-43bb-aaf4-d3ac14372741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:40:05.815323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:40:05.877472 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 483/974] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:40:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:40:06.142645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53da71c-e5e6-451c-a277-22783de2b2ab None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:06.230903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:40:06.242264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53da71c-e5e6-451c-a277-22783de2b2ab None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:06.277890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b47e0-a40a-4ddb-accf-a816db5569bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:06.278518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b47e0-a40a-4ddb-accf-a816db5569bd None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:06.278796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b47e0-a40a-4ddb-accf-a816db5569bd None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:06.279074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b47e0-a40a-4ddb-accf-a816db5569bd None admin] PATH_INFO: `/v3/services/placement` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:06.279678 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b47e0-a40a-4ddb-accf-a816db5569bd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:06.281122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b47e0-a40a-4ddb-accf-a816db5569bd None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-111b47e0-a40a-4ddb-accf-a816db5569bd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:40:06.290363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:40:06.291744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:40:06.292698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 492/975] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 04:40:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:40:06.298408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eee348-2b9d-43bb-aaf4-d3ac14372741 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:06.396154 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eee348-2b9d-43bb-aaf4-d3ac14372741 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:06.428773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768a6ed-21a1-49b4-916e-6734af51c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:06.429366 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a6ed-21a1-49b4-916e-6734af51c1ee None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:06.429648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a6ed-21a1-49b4-916e-6734af51c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:06.429924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a6ed-21a1-49b4-916e-6734af51c1ee None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:06.430545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768a6ed-21a1-49b4-916e-6734af51c1ee None admin] RBAC: Adding query filter params (name=placement) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:40:06.430849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768a6ed-21a1-49b4-916e-6734af51c1ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:06.432808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768a6ed-21a1-49b4-916e-6734af51c1ee None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:06.437743 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 484/976] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Oct 12 04:40:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:40:06.443671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b47e0-a40a-4ddb-accf-a816db5569bd None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:06.539912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b47e0-a40a-4ddb-accf-a816db5569bd None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:06.575190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d96aa-6065-40bf-bdb9-8793c8ab3520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:06.575825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d96aa-6065-40bf-bdb9-8793c8ab3520 None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:06.576104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d96aa-6065-40bf-bdb9-8793c8ab3520 None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:06.576382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d96aa-6065-40bf-bdb9-8793c8ab3520 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:06.577073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d96aa-6065-40bf-bdb9-8793c8ab3520 None admin] RBAC: Adding query filter params (interface=public, service_id=3e45d61aabbb4ab8b8c8020760c127bc, region_id=RegionOne) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:40:06.577871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d96aa-6065-40bf-bdb9-8793c8ab3520 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:06.578721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d96aa-6065-40bf-bdb9-8793c8ab3520 None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:06.583706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 493/977] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Oct 12 04:40:06 2022] GET /identity/v3/endpoints?service_id=3e45d61aabbb4ab8b8c8020760c127bc&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:40:06.589560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768a6ed-21a1-49b4-916e-6734af51c1ee None admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:06.593299 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:40:06.685420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768a6ed-21a1-49b4-916e-6734af51c1ee None admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:06.717725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97d34e-63a0-40d9-b526-78375f6e3fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:06.718315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97d34e-63a0-40d9-b526-78375f6e3fdc None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:06.718591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97d34e-63a0-40d9-b526-78375f6e3fdc None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:06.718860 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97d34e-63a0-40d9-b526-78375f6e3fdc None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:06.719500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97d34e-63a0-40d9-b526-78375f6e3fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:06.720846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97d34e-63a0-40d9-b526-78375f6e3fdc None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:06.727332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 485/978] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Oct 12 04:40:06 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:40:08.824758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2831d6-b376-4cc6-9d08-64cd7bf97562 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:08.825303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2831d6-b376-4cc6-9d08-64cd7bf97562 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:08.825303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2831d6-b376-4cc6-9d08-64cd7bf97562 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:08.826630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 494/979] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:40:08.831756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28476994-12cf-4489-908b-a57277fcd09c None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:08.832139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28476994-12cf-4489-908b-a57277fcd09c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:08.832267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28476994-12cf-4489-908b-a57277fcd09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:08.850855 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-28476994-12cf-4489-908b-a57277fcd09c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:40:08.852070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-28476994-12cf-4489-908b-a57277fcd09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:40:08.910687 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:40:08.916312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 486/980] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:40:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 04:40:09.178826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2831d6-b376-4cc6-9d08-64cd7bf97562 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:09.198582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:40:09.287093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2831d6-b376-4cc6-9d08-64cd7bf97562 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:09.325307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f753-f009-423e-99ed-19409522022b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:09.325933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f753-f009-423e-99ed-19409522022b None admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:09.326213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f753-f009-423e-99ed-19409522022b None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:09.326486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f753-f009-423e-99ed-19409522022b None admin] PATH_INFO: `/v3/services/placement` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:09.327052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f753-f009-423e-99ed-19409522022b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:09.328441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f753-f009-423e-99ed-19409522022b None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application [None req-f673f753-f009-423e-99ed-19409522022b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 04:40:09.337172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 04:40:09.339439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application with Lock( Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self._enter() Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application return self.creator() Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application created_value = creator( Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: ERROR keystone.server.flask.application Oct 12 04:40:09.340311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 495/981] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Oct 12 04:40:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 04:40:09.344274 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28476994-12cf-4489-908b-a57277fcd09c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:09.438892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28476994-12cf-4489-908b-a57277fcd09c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:09.471243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9080941-fe92-4615-a5b0-31ac1f1714a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:09.471881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080941-fe92-4615-a5b0-31ac1f1714a0 None admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:09.472161 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080941-fe92-4615-a5b0-31ac1f1714a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:09.472433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9080941-fe92-4615-a5b0-31ac1f1714a0 None admin] PATH_INFO: `/v3/services` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:09.473051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9080941-fe92-4615-a5b0-31ac1f1714a0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:40:09.473355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9080941-fe92-4615-a5b0-31ac1f1714a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:09.474697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9080941-fe92-4615-a5b0-31ac1f1714a0 None admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:09.479586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 487/982] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Oct 12 04:40:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:40:09.485108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f753-f009-423e-99ed-19409522022b None admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:40:09.563848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:40:09.582022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f753-f009-423e-99ed-19409522022b None admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:40:09.614927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343bf79-2d6c-43ff-8bf2-a5ecddc2ec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:40:09.615561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343bf79-2d6c-43ff-8bf2-a5ecddc2ec4f None admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:40:09.615843 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343bf79-2d6c-43ff-8bf2-a5ecddc2ec4f None admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:40:09.616116 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343bf79-2d6c-43ff-8bf2-a5ecddc2ec4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:40:09.616774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343bf79-2d6c-43ff-8bf2-a5ecddc2ec4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:40:09.618148 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343bf79-2d6c-43ff-8bf2-a5ecddc2ec4f None admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:40:09.638979 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 496/983] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:40:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:40:19.476696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=69 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:40:19.634196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:12.979654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cc8b8-925c-421f-ba85-a07cb433737a None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:12.980181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cc8b8-925c-421f-ba85-a07cb433737a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:12.980181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cc8b8-925c-421f-ba85-a07cb433737a None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:12.987189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427ce7c-4f96-4ffa-9880-56260246dfa5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:12.987577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427ce7c-4f96-4ffa-9880-56260246dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:12.987807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427ce7c-4f96-4ffa-9880-56260246dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:12.991366 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 488/984] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:41:13.108700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a427ce7c-4f96-4ffa-9880-56260246dfa5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:13.110116 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a427ce7c-4f96-4ffa-9880-56260246dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:13.231377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 497/985] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:13.536984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df73c5-ada7-4da7-b10f-c9cc7ecae7c5 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:13.537617 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df73c5-ada7-4da7-b10f-c9cc7ecae7c5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:13.537617 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df73c5-ada7-4da7-b10f-c9cc7ecae7c5 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:13.538923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 489/986] 10.222.0.18 () {54 vars in 964 bytes} [Wed Oct 12 04:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:13.545406 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55584e-4e3c-44fe-87dc-e73798b1d280 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:13.545696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55584e-4e3c-44fe-87dc-e73798b1d280 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:13.545972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55584e-4e3c-44fe-87dc-e73798b1d280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:13.634970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-ab55584e-4e3c-44fe-87dc-e73798b1d280 None None] MFA Rules not processed for user `dc59d3cc1fbc4d4382bffd8ae93075e1`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:13.636198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ab55584e-4e3c-44fe-87dc-e73798b1d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:13.657599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:13.716735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 498/987] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Oct 12 04:41:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:41:13.726312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df73c5-ada7-4da7-b10f-c9cc7ecae7c5 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:13.728144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-75df73c5-ada7-4da7-b10f-c9cc7ecae7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:13.844722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df73c5-ada7-4da7-b10f-c9cc7ecae7c5 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:13.926840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195895-b114-4370-b6f5-74b23d7c1373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:13.927494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195895-b114-4370-b6f5-74b23d7c1373 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:13.927775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195895-b114-4370-b6f5-74b23d7c1373 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:13.928060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195895-b114-4370-b6f5-74b23d7c1373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:13.930158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fc195895-b114-4370-b6f5-74b23d7c1373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:13.987694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:14.045342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195895-b114-4370-b6f5-74b23d7c1373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:14.046787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195895-b114-4370-b6f5-74b23d7c1373 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:14.066002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 490/988] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:16.541380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f32bb-de0b-48ed-8089-1b1e93a58575 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:16.541946 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f32bb-de0b-48ed-8089-1b1e93a58575 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:16.542054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f32bb-de0b-48ed-8089-1b1e93a58575 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:16.543475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 499/989] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:16.548921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e6897-904b-47df-919e-1f68a96d22c2 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:16.549298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e6897-904b-47df-919e-1f68a96d22c2 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:16.549503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e6897-904b-47df-919e-1f68a96d22c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:16.634205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-d05e6897-904b-47df-919e-1f68a96d22c2 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:16.635433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d05e6897-904b-47df-919e-1f68a96d22c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:16.732588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 491/990] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:17.017998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f32bb-de0b-48ed-8089-1b1e93a58575 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:17.019891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-aa9f32bb-de0b-48ed-8089-1b1e93a58575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:17.123549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f32bb-de0b-48ed-8089-1b1e93a58575 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:17.193776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:17.196300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948b2a8-814c-4a83-95ce-eb78bfdfba87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:17.197122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b2a8-814c-4a83-95ce-eb78bfdfba87 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:17.197453 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b2a8-814c-4a83-95ce-eb78bfdfba87 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:17.197897 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b2a8-814c-4a83-95ce-eb78bfdfba87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:17.199746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1948b2a8-814c-4a83-95ce-eb78bfdfba87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:17.306899 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948b2a8-814c-4a83-95ce-eb78bfdfba87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:17.308304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948b2a8-814c-4a83-95ce-eb78bfdfba87 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:17.326340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 500/991] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:19.744680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253edc9-7004-4b1a-904a-837e545c9bf5 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:19.745219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253edc9-7004-4b1a-904a-837e545c9bf5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:19.745219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253edc9-7004-4b1a-904a-837e545c9bf5 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:19.746571 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 492/992] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:19.751845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963d77-e731-41e0-94e5-26a216cdd87c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:19.752263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963d77-e731-41e0-94e5-26a216cdd87c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:19.752385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963d77-e731-41e0-94e5-26a216cdd87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:19.816484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-3f963d77-e731-41e0-94e5-26a216cdd87c None None] MFA Rules not processed for user `e0bb918e2d4a4c2bb8397e90b95b6925`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:19.817680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3f963d77-e731-41e0-94e5-26a216cdd87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:19.868061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:19.910476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 501/993] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:20.192527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253edc9-7004-4b1a-904a-837e545c9bf5 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:20.194637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2253edc9-7004-4b1a-904a-837e545c9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:20.204348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:20.297302 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253edc9-7004-4b1a-904a-837e545c9bf5 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:20.370097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfe8c6-2de2-4123-8519-5554eaf08a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:20.370698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfe8c6-2de2-4123-8519-5554eaf08a57 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:20.370981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfe8c6-2de2-4123-8519-5554eaf08a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:20.371256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfe8c6-2de2-4123-8519-5554eaf08a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:20.372863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0bdfe8c6-2de2-4123-8519-5554eaf08a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:20.432821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:20.479267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfe8c6-2de2-4123-8519-5554eaf08a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:20.480795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfe8c6-2de2-4123-8519-5554eaf08a57 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:20.499768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 493/994] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:23.151302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde22dc-e8b7-49e5-b445-c9e0687b9efc None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:23.151859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde22dc-e8b7-49e5-b445-c9e0687b9efc None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:23.151859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde22dc-e8b7-49e5-b445-c9e0687b9efc None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:23.153205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 502/995] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:23.158369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a3167-d401-4fd5-9164-177add14a441 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:23.158810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a3167-d401-4fd5-9164-177add14a441 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:23.158934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a3167-d401-4fd5-9164-177add14a441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:23.223997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-276a3167-d401-4fd5-9164-177add14a441 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:23.225821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-276a3167-d401-4fd5-9164-177add14a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:23.320973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 494/996] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:23.604197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde22dc-e8b7-49e5-b445-c9e0687b9efc None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:23.605890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-adde22dc-e8b7-49e5-b445-c9e0687b9efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:23.705796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde22dc-e8b7-49e5-b445-c9e0687b9efc None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:23.776771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113bb27-f61c-4047-af78-67aa483f7864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:23.777367 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113bb27-f61c-4047-af78-67aa483f7864 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:23.777645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113bb27-f61c-4047-af78-67aa483f7864 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:23.777916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113bb27-f61c-4047-af78-67aa483f7864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:23.779508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5113bb27-f61c-4047-af78-67aa483f7864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:23.786173 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:23.886786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113bb27-f61c-4047-af78-67aa483f7864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:23.888190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113bb27-f61c-4047-af78-67aa483f7864 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:23.906663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 503/997] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:26.684737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d6619-c31b-412e-8265-4adddd253858 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:26.685305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d6619-c31b-412e-8265-4adddd253858 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:26.685305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d6619-c31b-412e-8265-4adddd253858 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:26.686705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 495/998] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:26.692169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1f7b-004f-41c9-b285-0b0e39711f8d None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:26.692701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1f7b-004f-41c9-b285-0b0e39711f8d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:26.692701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1f7b-004f-41c9-b285-0b0e39711f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:26.764853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d8ce1f7b-004f-41c9-b285-0b0e39711f8d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:26.766077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d8ce1f7b-004f-41c9-b285-0b0e39711f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:26.827051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:26.868703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 504/999] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:27.154342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d6619-c31b-412e-8265-4adddd253858 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:27.155927 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-262d6619-c31b-412e-8265-4adddd253858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:27.175943 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:27.261787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d6619-c31b-412e-8265-4adddd253858 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:27.337330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428aa31-d304-4bc3-9b7a-9aa928ce7a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:27.337941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428aa31-d304-4bc3-9b7a-9aa928ce7a8d service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:27.338222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428aa31-d304-4bc3-9b7a-9aa928ce7a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:27.338496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428aa31-d304-4bc3-9b7a-9aa928ce7a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:27.340115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0428aa31-d304-4bc3-9b7a-9aa928ce7a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:27.413759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:27.451748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428aa31-d304-4bc3-9b7a-9aa928ce7a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:27.453217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428aa31-d304-4bc3-9b7a-9aa928ce7a8d service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:27.470964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 496/1000] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:29.673530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e245e9-3786-433a-b8d2-f9e0b006c168 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:29.674477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e245e9-3786-433a-b8d2-f9e0b006c168 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:29.674967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e245e9-3786-433a-b8d2-f9e0b006c168 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:29.676411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 505/1001] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:29.682240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786661-6459-408a-b667-ee99d45fb76d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:29.682673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786661-6459-408a-b667-ee99d45fb76d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:29.682779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786661-6459-408a-b667-ee99d45fb76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:29.749460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-4b786661-6459-408a-b667-ee99d45fb76d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:29.750564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4b786661-6459-408a-b667-ee99d45fb76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:29.852300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 497/1002] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:30.135843 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e245e9-3786-433a-b8d2-f9e0b006c168 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:30.137473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e1e245e9-3786-433a-b8d2-f9e0b006c168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:30.239672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e245e9-3786-433a-b8d2-f9e0b006c168 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:30.312576 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840daa73-3f90-440b-a9f8-b9cc21c7a2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:30.313182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840daa73-3f90-440b-a9f8-b9cc21c7a2ba service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:30.313461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840daa73-3f90-440b-a9f8-b9cc21c7a2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:30.313735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840daa73-3f90-440b-a9f8-b9cc21c7a2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:30.315332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-840daa73-3f90-440b-a9f8-b9cc21c7a2ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:30.332619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:30.426380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840daa73-3f90-440b-a9f8-b9cc21c7a2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:30.427795 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840daa73-3f90-440b-a9f8-b9cc21c7a2ba service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:30.446204 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 506/1003] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:32.688563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b5ae-c6f8-4541-9d22-e02c40078085 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:32.689066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b5ae-c6f8-4541-9d22-e02c40078085 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:32.689066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b5ae-c6f8-4541-9d22-e02c40078085 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:32.690374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 498/1004] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:32.696146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17836-ff3d-4f41-a0da-bb457aff2dc3 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:32.696569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17836-ff3d-4f41-a0da-bb457aff2dc3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:32.696692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17836-ff3d-4f41-a0da-bb457aff2dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:32.764518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-89b17836-ff3d-4f41-a0da-bb457aff2dc3 None None] MFA Rules not processed for user `e0bb918e2d4a4c2bb8397e90b95b6925`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:32.765716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-89b17836-ff3d-4f41-a0da-bb457aff2dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:32.828958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:32.861753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 507/1005] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:33.145623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088b5ae-c6f8-4541-9d22-e02c40078085 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:33.147887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e088b5ae-c6f8-4541-9d22-e02c40078085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:33.185692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:33.267065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088b5ae-c6f8-4541-9d22-e02c40078085 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:33.351909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460f56c-6413-4c2d-b976-6960de4793cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:33.352797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460f56c-6413-4c2d-b976-6960de4793cf service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:33.353229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460f56c-6413-4c2d-b976-6960de4793cf service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:33.353673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460f56c-6413-4c2d-b976-6960de4793cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:33.355447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e460f56c-6413-4c2d-b976-6960de4793cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:33.438087 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:33.469933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460f56c-6413-4c2d-b976-6960de4793cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:33.471370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460f56c-6413-4c2d-b976-6960de4793cf service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:33.489894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 499/1006] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:35.856565 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88f52-5c3e-44f7-81e1-55594d2d2ea3 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:35.857123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88f52-5c3e-44f7-81e1-55594d2d2ea3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:35.857123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88f52-5c3e-44f7-81e1-55594d2d2ea3 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:35.858416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 508/1007] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:35.863650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c14d-11c6-446e-9c33-bc1cf0bab280 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:35.864089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c14d-11c6-446e-9c33-bc1cf0bab280 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:35.864187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c14d-11c6-446e-9c33-bc1cf0bab280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:35.928888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6841c14d-11c6-446e-9c33-bc1cf0bab280 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:35.930096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6841c14d-11c6-446e-9c33-bc1cf0bab280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:36.024136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 500/1008] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:36.301712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d88f52-5c3e-44f7-81e1-55594d2d2ea3 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:36.303900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a2d88f52-5c3e-44f7-81e1-55594d2d2ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:36.404073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d88f52-5c3e-44f7-81e1-55594d2d2ea3 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:36.476064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbba5c-e298-4e95-8a72-1fcb4abcf094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:36.476662 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbba5c-e298-4e95-8a72-1fcb4abcf094 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:36.476943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbba5c-e298-4e95-8a72-1fcb4abcf094 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:36.477220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbba5c-e298-4e95-8a72-1fcb4abcf094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:36.478799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1fcbba5c-e298-4e95-8a72-1fcb4abcf094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:36.505655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:36.587069 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbba5c-e298-4e95-8a72-1fcb4abcf094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:36.588548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbba5c-e298-4e95-8a72-1fcb4abcf094 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:36.607039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 509/1009] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:38.772122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49072-f972-48f9-89b9-d70f00152930 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:38.772671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49072-f972-48f9-89b9-d70f00152930 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:38.772671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49072-f972-48f9-89b9-d70f00152930 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:38.773988 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 501/1010] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:38.779086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb473b-0a5d-400b-ad8d-f9f582182efa None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:38.779489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb473b-0a5d-400b-ad8d-f9f582182efa None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:38.779672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb473b-0a5d-400b-ad8d-f9f582182efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:38.843608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-cefb473b-0a5d-400b-ad8d-f9f582182efa None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:38.844725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cefb473b-0a5d-400b-ad8d-f9f582182efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:38.917843 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:38.939542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 510/1011] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:39.222443 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49072-f972-48f9-89b9-d70f00152930 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:39.224558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-cde49072-f972-48f9-89b9-d70f00152930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:39.264640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:39.326417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49072-f972-48f9-89b9-d70f00152930 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:39.397715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c6e70-8222-4a2c-9f4d-604f607bcb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:39.398319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c6e70-8222-4a2c-9f4d-604f607bcb7f service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:39.398602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c6e70-8222-4a2c-9f4d-604f607bcb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:39.398880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c6e70-8222-4a2c-9f4d-604f607bcb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:39.400485 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-490c6e70-8222-4a2c-9f4d-604f607bcb7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:39.482470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:39.507985 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c6e70-8222-4a2c-9f4d-604f607bcb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:39.509403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c6e70-8222-4a2c-9f4d-604f607bcb7f service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:39.527163 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 502/1012] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:41.969860 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7f0a-ac3b-4aab-a705-d02ea85d86e6 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:41.970408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7f0a-ac3b-4aab-a705-d02ea85d86e6 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:41.970408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7f0a-ac3b-4aab-a705-d02ea85d86e6 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:41.971795 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 511/1013] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:41.977637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f23a-3cc9-49ad-9456-6e1e27c40a0e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:41.978142 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f23a-3cc9-49ad-9456-6e1e27c40a0e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:41.978245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f23a-3cc9-49ad-9456-6e1e27c40a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:42.041775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e736f23a-3cc9-49ad-9456-6e1e27c40a0e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:42.042960 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e736f23a-3cc9-49ad-9456-6e1e27c40a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:42.137231 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 503/1014] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:42.416318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7f0a-ac3b-4aab-a705-d02ea85d86e6 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:42.417853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-78fc7f0a-ac3b-4aab-a705-d02ea85d86e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:42.518044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7f0a-ac3b-4aab-a705-d02ea85d86e6 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:42.590583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3408a8b-01a1-455b-b43d-e461a2e24186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:42.591193 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3408a8b-01a1-455b-b43d-e461a2e24186 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:42.591501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3408a8b-01a1-455b-b43d-e461a2e24186 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:42.591777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3408a8b-01a1-455b-b43d-e461a2e24186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:42.593345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b3408a8b-01a1-455b-b43d-e461a2e24186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:42.628012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:42.701469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3408a8b-01a1-455b-b43d-e461a2e24186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:42.702902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3408a8b-01a1-455b-b43d-e461a2e24186 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:42.721071 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 512/1015] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:46.733934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3b285-402f-4285-b62b-94dbbab38643 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:46.734458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3b285-402f-4285-b62b-94dbbab38643 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:46.734458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3b285-402f-4285-b62b-94dbbab38643 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:46.735897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 504/1016] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:46.741158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb825ed-c18d-4888-ad35-231b31540dcd None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:46.741557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb825ed-c18d-4888-ad35-231b31540dcd None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:46.741701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb825ed-c18d-4888-ad35-231b31540dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:46.805844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-7cb825ed-c18d-4888-ad35-231b31540dcd None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:46.806927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-7cb825ed-c18d-4888-ad35-231b31540dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:46.891531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:46.903874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 513/1017] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:47.195209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3b285-402f-4285-b62b-94dbbab38643 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:47.196772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9ef3b285-402f-4285-b62b-94dbbab38643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:47.246477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:47.302290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3b285-402f-4285-b62b-94dbbab38643 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:47.375267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac320ec-7dee-475d-8ca9-141282929c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:47.375903 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac320ec-7dee-475d-8ca9-141282929c4e service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:47.376185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac320ec-7dee-475d-8ca9-141282929c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:47.376462 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac320ec-7dee-475d-8ca9-141282929c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:47.378052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-cac320ec-7dee-475d-8ca9-141282929c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:47.471569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:47.489892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac320ec-7dee-475d-8ca9-141282929c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:47.491388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac320ec-7dee-475d-8ca9-141282929c4e service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:47.509361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 505/1018] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:50.287925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698663-ab99-4eee-9b7d-73d43a32aa26 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:50.288449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698663-ab99-4eee-9b7d-73d43a32aa26 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:50.288563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698663-ab99-4eee-9b7d-73d43a32aa26 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:50.289863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 514/1019] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:50.295132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94c5f5-a3b2-495f-a290-757e2eab8dd0 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:50.295579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94c5f5-a3b2-495f-a290-757e2eab8dd0 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:50.295743 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94c5f5-a3b2-495f-a290-757e2eab8dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:50.361053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-fe94c5f5-a3b2-495f-a290-757e2eab8dd0 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:50.362250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fe94c5f5-a3b2-495f-a290-757e2eab8dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:50.458092 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 506/1020] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:50.742386 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0698663-ab99-4eee-9b7d-73d43a32aa26 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:50.744003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a0698663-ab99-4eee-9b7d-73d43a32aa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:50.852217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0698663-ab99-4eee-9b7d-73d43a32aa26 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:50.925419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468bd50-2fb6-4cc0-9797-09e55d77e6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:50.926028 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468bd50-2fb6-4cc0-9797-09e55d77e6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:50.926308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468bd50-2fb6-4cc0-9797-09e55d77e6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:50.926581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468bd50-2fb6-4cc0-9797-09e55d77e6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:50.928188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f468bd50-2fb6-4cc0-9797-09e55d77e6e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:50.971322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:51.041819 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468bd50-2fb6-4cc0-9797-09e55d77e6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:51.043258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468bd50-2fb6-4cc0-9797-09e55d77e6e5 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:51.061317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 515/1021] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:41:55.171172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d28123-f600-4be9-9490-d95d47707e25 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:55.171710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d28123-f600-4be9-9490-d95d47707e25 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:55.171815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d28123-f600-4be9-9490-d95d47707e25 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:55.173113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 507/1022] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:41:55.179085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836429f-9440-4f99-9a07-3dbd12ffddce None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:55.179539 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836429f-9440-4f99-9a07-3dbd12ffddce None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:55.179668 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836429f-9440-4f99-9a07-3dbd12ffddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:55.249342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-9836429f-9440-4f99-9a07-3dbd12ffddce None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:41:55.251397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9836429f-9440-4f99-9a07-3dbd12ffddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:55.347727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:55.350080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 516/1023] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:41:55.632029 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d28123-f600-4be9-9490-d95d47707e25 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:41:55.633588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-79d28123-f600-4be9-9490-d95d47707e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:55.691071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:55.737496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d28123-f600-4be9-9490-d95d47707e25 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:41:55.809119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9b053-dfde-47a3-b247-ca20086bc520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:41:55.809720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b053-dfde-47a3-b247-ca20086bc520 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:41:55.810004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b053-dfde-47a3-b247-ca20086bc520 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:41:55.810278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b053-dfde-47a3-b247-ca20086bc520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:41:55.811887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-58a9b053-dfde-47a3-b247-ca20086bc520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:41:55.915137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:41:55.919238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9b053-dfde-47a3-b247-ca20086bc520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:41:55.920704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9b053-dfde-47a3-b247-ca20086bc520 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:41:55.938196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 508/1024] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:00.872463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989a2c-9b19-4bc7-ad66-9f9cbb2ecf06 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:00.872881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989a2c-9b19-4bc7-ad66-9f9cbb2ecf06 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:00.873058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989a2c-9b19-4bc7-ad66-9f9cbb2ecf06 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:00.874799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 517/1025] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:00.880320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297f45a-9bf3-44c5-8bc5-0be9774833f9 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:00.880714 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297f45a-9bf3-44c5-8bc5-0be9774833f9 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:00.880908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297f45a-9bf3-44c5-8bc5-0be9774833f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:00.969558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5297f45a-9bf3-44c5-8bc5-0be9774833f9 None None] MFA Rules not processed for user `332a44161d204223983ed2aa3aef9317`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:00.970754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5297f45a-9bf3-44c5-8bc5-0be9774833f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:01.166496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 509/1026] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:42:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:05.311831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6a492-2a7c-4d1f-a704-0153d61dfbc8 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:05.312438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6a492-2a7c-4d1f-a704-0153d61dfbc8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:05.312438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6a492-2a7c-4d1f-a704-0153d61dfbc8 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:05.314000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 518/1027] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:05.319107 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32404-9ca2-4d8e-ba08-9aa6a39c04db None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:05.319587 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32404-9ca2-4d8e-ba08-9aa6a39c04db None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:05.319894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32404-9ca2-4d8e-ba08-9aa6a39c04db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:05.388398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:05.413718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-9bd32404-9ca2-4d8e-ba08-9aa6a39c04db None None] MFA Rules not processed for user `332a44161d204223983ed2aa3aef9317`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:05.415039 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9bd32404-9ca2-4d8e-ba08-9aa6a39c04db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:05.526296 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 510/1028] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:42:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:42:06.821124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248fef-cd74-4579-b9e6-2da4635c801b None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:06.821677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248fef-cd74-4579-b9e6-2da4635c801b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:06.821780 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248fef-cd74-4579-b9e6-2da4635c801b None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:06.823198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 519/1029] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:06.828301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e012a78-7f2d-45a0-9177-6e8a83d3209e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:06.828747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e012a78-7f2d-45a0-9177-6e8a83d3209e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:06.828860 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e012a78-7f2d-45a0-9177-6e8a83d3209e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:06.905926 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-7e012a78-7f2d-45a0-9177-6e8a83d3209e None None] MFA Rules not processed for user `332a44161d204223983ed2aa3aef9317`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:06.907126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-7e012a78-7f2d-45a0-9177-6e8a83d3209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:06.947581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:07.010737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 511/1030] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:42:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:42:10.588983 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de108aba-d4d8-4524-ab75-8284614a08c3 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:10.589845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de108aba-d4d8-4524-ab75-8284614a08c3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:10.590120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de108aba-d4d8-4524-ab75-8284614a08c3 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:10.591646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 520/1031] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:10.597735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8af2-0710-4891-b1cc-27f9b9847edf None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:10.598514 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8af2-0710-4891-b1cc-27f9b9847edf None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:10.599884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8af2-0710-4891-b1cc-27f9b9847edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:10.682898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-94bc8af2-0710-4891-b1cc-27f9b9847edf None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:10.684711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-94bc8af2-0710-4891-b1cc-27f9b9847edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:10.794459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 512/1032] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:11.098149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13067-5762-45d3-aa51-901ba8fe6718 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:11.098439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13067-5762-45d3-aa51-901ba8fe6718 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:11.098714 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13067-5762-45d3-aa51-901ba8fe6718 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:11.100518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 521/1033] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 04:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:11.107561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d2d62-c185-4cf9-8fd7-a15abf89af15 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:11.108275 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d2d62-c185-4cf9-8fd7-a15abf89af15 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:11.108718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d2d62-c185-4cf9-8fd7-a15abf89af15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:11.130460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:11.205553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e73d2d62-c185-4cf9-8fd7-a15abf89af15 None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:11.206887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e73d2d62-c185-4cf9-8fd7-a15abf89af15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:11.335000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 513/1034] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 04:42:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:11.342876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f13067-5762-45d3-aa51-901ba8fe6718 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:11.344533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c6f13067-5762-45d3-aa51-901ba8fe6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:11.508018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f13067-5762-45d3-aa51-901ba8fe6718 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:11.597349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:11.639718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87929d6-0392-4860-aa47-49d0a02ca631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:11.640322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87929d6-0392-4860-aa47-49d0a02ca631 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:11.640606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87929d6-0392-4860-aa47-49d0a02ca631 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:11.640881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87929d6-0392-4860-aa47-49d0a02ca631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:11.642474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d87929d6-0392-4860-aa47-49d0a02ca631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:11.745128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87929d6-0392-4860-aa47-49d0a02ca631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:11.746727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87929d6-0392-4860-aa47-49d0a02ca631 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:11.766548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 522/1035] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:14.138666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d0b49-3253-4d2f-8031-0e27540ceccf None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:14.138666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d0b49-3253-4d2f-8031-0e27540ceccf None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:14.138666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d0b49-3253-4d2f-8031-0e27540ceccf None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:14.144745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 514/1036] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:14.145655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231225-1373-405a-a244-43a749ef07fa None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:14.146027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231225-1373-405a-a244-43a749ef07fa None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:14.146351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231225-1373-405a-a244-43a749ef07fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:14.214598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-71231225-1373-405a-a244-43a749ef07fa None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:14.215846 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-71231225-1373-405a-a244-43a749ef07fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:14.257205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:14.320544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 523/1037] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:14.614738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d0b49-3253-4d2f-8031-0e27540ceccf None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:14.616280 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1f6d0b49-3253-4d2f-8031-0e27540ceccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:14.707023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:14.812042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d0b49-3253-4d2f-8031-0e27540ceccf None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:14.945908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a34e7-0f78-4107-b271-bd547a58edbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:14.946528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a34e7-0f78-4107-b271-bd547a58edbb service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:14.946808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a34e7-0f78-4107-b271-bd547a58edbb service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:14.947081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a34e7-0f78-4107-b271-bd547a58edbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:14.948733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f89a34e7-0f78-4107-b271-bd547a58edbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:14.972850 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:15.042868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a34e7-0f78-4107-b271-bd547a58edbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:15.044520 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a34e7-0f78-4107-b271-bd547a58edbb service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:15.063775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 515/1038] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:17.564470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec9396-9d5e-4a07-a319-dd3a1768de13 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:17.564995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec9396-9d5e-4a07-a319-dd3a1768de13 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:17.564995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec9396-9d5e-4a07-a319-dd3a1768de13 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:17.566342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 524/1039] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:17.571752 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569349-f527-4258-b67c-0de937d6a671 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:17.572172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569349-f527-4258-b67c-0de937d6a671 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:17.572389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569349-f527-4258-b67c-0de937d6a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:17.640977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-25569349-f527-4258-b67c-0de937d6a671 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:17.642192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-25569349-f527-4258-b67c-0de937d6a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:17.744402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:17.754169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 516/1040] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:18.040136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82ed68-7860-414b-870c-bfcd1a199c13 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:18.040531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82ed68-7860-414b-870c-bfcd1a199c13 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:18.040910 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82ed68-7860-414b-870c-bfcd1a199c13 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:18.042341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 525/1041] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 04:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:18.047615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be31d1-0ffc-4b0f-9e47-1ba529217776 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:18.047910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be31d1-0ffc-4b0f-9e47-1ba529217776 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:18.048188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be31d1-0ffc-4b0f-9e47-1ba529217776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:18.128223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-71be31d1-0ffc-4b0f-9e47-1ba529217776 None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:18.129432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-71be31d1-0ffc-4b0f-9e47-1ba529217776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:18.253813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 517/1042] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:18.261792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82ed68-7860-414b-870c-bfcd1a199c13 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:18.263383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4d82ed68-7860-414b-870c-bfcd1a199c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:18.417564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82ed68-7860-414b-870c-bfcd1a199c13 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:18.438814 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:18.539060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a05c74-572a-4011-8d6e-6104da16f907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:18.539692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a05c74-572a-4011-8d6e-6104da16f907 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:18.539963 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a05c74-572a-4011-8d6e-6104da16f907 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:18.540229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a05c74-572a-4011-8d6e-6104da16f907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:18.541825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d3a05c74-572a-4011-8d6e-6104da16f907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:18.646779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a05c74-572a-4011-8d6e-6104da16f907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:18.648543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a05c74-572a-4011-8d6e-6104da16f907 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:18.669325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 526/1043] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:18.745633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e31ce-f806-4747-b31d-4ef7af501848 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:18.746138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e31ce-f806-4747-b31d-4ef7af501848 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:18.746255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e31ce-f806-4747-b31d-4ef7af501848 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:18.747539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 518/1044] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:18.752817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d6737-6bb4-4c59-85cc-f2651dd4f32c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:18.753109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d6737-6bb4-4c59-85cc-f2651dd4f32c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:18.753390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d6737-6bb4-4c59-85cc-f2651dd4f32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:18.788075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:18.831243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-3f6d6737-6bb4-4c59-85cc-f2651dd4f32c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:18.832799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3f6d6737-6bb4-4c59-85cc-f2651dd4f32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:18.950964 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 527/1045] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:19.286584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e657a-10e9-49fe-b6db-e38fc5a2131f None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:19.286584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e657a-10e9-49fe-b6db-e38fc5a2131f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:19.286584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e657a-10e9-49fe-b6db-e38fc5a2131f None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:19.288225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 519/1046] 10.222.0.18 () {54 vars in 963 bytes} [Wed Oct 12 04:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:19.293138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb1cfb-2c42-47ff-81dd-d5276d2b0e2e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:19.293538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb1cfb-2c42-47ff-81dd-d5276d2b0e2e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:19.293911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb1cfb-2c42-47ff-81dd-d5276d2b0e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:19.374818 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c0fb1cfb-2c42-47ff-81dd-d5276d2b0e2e None None] MFA Rules not processed for user `946db23ba1fe47999ae12f8380f4c48a`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:19.376224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c0fb1cfb-2c42-47ff-81dd-d5276d2b0e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:19.431998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:19.464254 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 528/1047] 10.222.0.18 () {58 vars in 1060 bytes} [Wed Oct 12 04:42:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:42:19.472276 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e657a-10e9-49fe-b6db-e38fc5a2131f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:19.473812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-df1e657a-10e9-49fe-b6db-e38fc5a2131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:19.528192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:19.593899 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e657a-10e9-49fe-b6db-e38fc5a2131f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:19.680805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060a74-15f3-4f75-994d-08639b46b76f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:19.681676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060a74-15f3-4f75-994d-08639b46b76f service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:19.682072 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060a74-15f3-4f75-994d-08639b46b76f service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:19.682615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060a74-15f3-4f75-994d-08639b46b76f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:19.685114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1d060a74-15f3-4f75-994d-08639b46b76f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:19.808188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:19.823927 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d060a74-15f3-4f75-994d-08639b46b76f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:19.825242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d060a74-15f3-4f75-994d-08639b46b76f service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:19.847584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 520/1048] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:20.907776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004861d4-1fbd-47eb-930c-75bcdc3c8ee3 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:20.908327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004861d4-1fbd-47eb-930c-75bcdc3c8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:20.908327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004861d4-1fbd-47eb-930c-75bcdc3c8ee3 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:20.910288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 529/1049] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:20.915697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731edfb-e9eb-4a73-ae34-4f06344b27c8 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:20.916096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731edfb-e9eb-4a73-ae34-4f06344b27c8 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:20.916258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731edfb-e9eb-4a73-ae34-4f06344b27c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:20.982423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c731edfb-e9eb-4a73-ae34-4f06344b27c8 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:20.983657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c731edfb-e9eb-4a73-ae34-4f06344b27c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:21.087309 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 521/1050] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:21.377857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004861d4-1fbd-47eb-930c-75bcdc3c8ee3 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:21.379458 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-004861d4-1fbd-47eb-930c-75bcdc3c8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:21.536835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004861d4-1fbd-47eb-930c-75bcdc3c8ee3 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:21.596212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:21.658082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a3210-f1b8-401e-b787-0d53f97af4ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:21.659220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a3210-f1b8-401e-b787-0d53f97af4ac service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:21.659528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a3210-f1b8-401e-b787-0d53f97af4ac service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:21.659800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a3210-f1b8-401e-b787-0d53f97af4ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:21.661382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e39a3210-f1b8-401e-b787-0d53f97af4ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:21.751972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a3210-f1b8-401e-b787-0d53f97af4ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:21.754106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a3210-f1b8-401e-b787-0d53f97af4ac service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:21.771994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 530/1051] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:23.958611 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d75f3f-014e-42a1-87d5-4821fe9ca75c None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:23.959130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d75f3f-014e-42a1-87d5-4821fe9ca75c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:23.959213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d75f3f-014e-42a1-87d5-4821fe9ca75c None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:23.960684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 522/1052] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:23.965685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2307010-6f31-4bcd-b69f-294647206682 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:23.966115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2307010-6f31-4bcd-b69f-294647206682 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:23.966280 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2307010-6f31-4bcd-b69f-294647206682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:24.032840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b2307010-6f31-4bcd-b69f-294647206682 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:24.034047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b2307010-6f31-4bcd-b69f-294647206682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:24.041193 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:24.135892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 531/1053] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:24.421585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d75f3f-014e-42a1-87d5-4821fe9ca75c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:24.423098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-09d75f3f-014e-42a1-87d5-4821fe9ca75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:24.487426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:24.583517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d75f3f-014e-42a1-87d5-4821fe9ca75c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:24.703702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4703ceb-8362-4653-ad43-06791c89a049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:24.704315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4703ceb-8362-4653-ad43-06791c89a049 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:24.704595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4703ceb-8362-4653-ad43-06791c89a049 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:24.704872 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4703ceb-8362-4653-ad43-06791c89a049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:24.707036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d4703ceb-8362-4653-ad43-06791c89a049 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:24.726478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:24.801195 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4703ceb-8362-4653-ad43-06791c89a049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:24.802767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4703ceb-8362-4653-ad43-06791c89a049 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:24.821084 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 523/1054] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:27.030461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df32ff2-f2a3-460e-b9c7-3b159cd36507 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:27.031052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df32ff2-f2a3-460e-b9c7-3b159cd36507 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:27.031052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df32ff2-f2a3-460e-b9c7-3b159cd36507 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:27.032551 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 532/1055] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:27.038092 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11364b0c-aaf5-4271-aa3e-a0a69bcabf46 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:27.038478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11364b0c-aaf5-4271-aa3e-a0a69bcabf46 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:27.038661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11364b0c-aaf5-4271-aa3e-a0a69bcabf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:27.108558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-11364b0c-aaf5-4271-aa3e-a0a69bcabf46 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:27.109822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-11364b0c-aaf5-4271-aa3e-a0a69bcabf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:27.217035 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:27.243627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 524/1056] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:27.525398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df32ff2-f2a3-460e-b9c7-3b159cd36507 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:27.527451 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3df32ff2-f2a3-460e-b9c7-3b159cd36507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:27.688213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:27.698933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df32ff2-f2a3-460e-b9c7-3b159cd36507 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:27.816462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99dd77-7531-4b97-80e6-ee77cc36a5ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:27.817188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99dd77-7531-4b97-80e6-ee77cc36a5ba service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:27.817530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99dd77-7531-4b97-80e6-ee77cc36a5ba service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:27.817812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99dd77-7531-4b97-80e6-ee77cc36a5ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:27.819471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1f99dd77-7531-4b97-80e6-ee77cc36a5ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:27.909158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99dd77-7531-4b97-80e6-ee77cc36a5ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:27.910655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99dd77-7531-4b97-80e6-ee77cc36a5ba service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:27.920451 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:27.928956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 533/1057] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:30.382715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f441-7603-4aea-b835-ae8480682c4f None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:30.383378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f441-7603-4aea-b835-ae8480682c4f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:30.383378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f441-7603-4aea-b835-ae8480682c4f None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:30.384511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 525/1058] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:30.389784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4e967-4bcf-4cb7-9c85-66c7573caec9 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:30.390244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4e967-4bcf-4cb7-9c85-66c7573caec9 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:30.390397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4e967-4bcf-4cb7-9c85-66c7573caec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:30.463201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-ebd4e967-4bcf-4cb7-9c85-66c7573caec9 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:30.464772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ebd4e967-4bcf-4cb7-9c85-66c7573caec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:30.585339 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 534/1059] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:30.870116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5f441-7603-4aea-b835-ae8480682c4f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:30.872107 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-90c5f441-7603-4aea-b835-ae8480682c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:31.027978 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5f441-7603-4aea-b835-ae8480682c4f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:31.101023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:31.154344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ede1a-91fa-405c-9695-6d4a6ee98459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:31.154879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ede1a-91fa-405c-9695-6d4a6ee98459 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:31.155163 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ede1a-91fa-405c-9695-6d4a6ee98459 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:31.155468 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ede1a-91fa-405c-9695-6d4a6ee98459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:31.157107 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ce6ede1a-91fa-405c-9695-6d4a6ee98459 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:31.258027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ede1a-91fa-405c-9695-6d4a6ee98459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:31.260186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ede1a-91fa-405c-9695-6d4a6ee98459 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:31.280780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 526/1060] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:33.445937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250795-92fa-4159-83ac-c20d8f07574a None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:33.446520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250795-92fa-4159-83ac-c20d8f07574a None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:33.446520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250795-92fa-4159-83ac-c20d8f07574a None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:33.448182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 535/1061] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:33.453585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c7e16-f5c2-43ea-b729-bbb8a83a3092 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:33.454031 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c7e16-f5c2-43ea-b729-bbb8a83a3092 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:33.454223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c7e16-f5c2-43ea-b729-bbb8a83a3092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:33.526871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b92c7e16-f5c2-43ea-b729-bbb8a83a3092 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:33.528130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b92c7e16-f5c2-43ea-b729-bbb8a83a3092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:33.563224 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:33.641663 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 527/1062] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:42:33.932625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250795-92fa-4159-83ac-c20d8f07574a None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:33.934144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c4250795-92fa-4159-83ac-c20d8f07574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:34.011186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:34.081410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250795-92fa-4159-83ac-c20d8f07574a None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:34.196658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7ecdf-db64-4da8-9b54-6fa9d9e88ed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:34.197187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ecdf-db64-4da8-9b54-6fa9d9e88ed7 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:34.197583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ecdf-db64-4da8-9b54-6fa9d9e88ed7 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:34.197865 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ecdf-db64-4da8-9b54-6fa9d9e88ed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:34.199506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-28e7ecdf-db64-4da8-9b54-6fa9d9e88ed7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:34.240696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:34.294176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7ecdf-db64-4da8-9b54-6fa9d9e88ed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:34.295822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7ecdf-db64-4da8-9b54-6fa9d9e88ed7 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:34.313277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 536/1063] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:35.101932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85fefc-cecd-4a06-b1d0-21168ce64ec3 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:35.102464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85fefc-cecd-4a06-b1d0-21168ce64ec3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:35.102464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85fefc-cecd-4a06-b1d0-21168ce64ec3 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:35.103890 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 528/1064] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:35.109318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394551d-c8a1-4d40-bcab-cd4fa99e99c7 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:35.109753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394551d-c8a1-4d40-bcab-cd4fa99e99c7 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:35.110048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394551d-c8a1-4d40-bcab-cd4fa99e99c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:35.179566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-6394551d-c8a1-4d40-bcab-cd4fa99e99c7 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:35.180775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-6394551d-c8a1-4d40-bcab-cd4fa99e99c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:35.280197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 537/1065] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:35.583703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1cfb4-f984-417b-beea-a8c874369af5 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:35.583988 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1cfb4-f984-417b-beea-a8c874369af5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:35.584263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1cfb4-f984-417b-beea-a8c874369af5 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:35.585588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 529/1066] 10.222.0.18 () {54 vars in 962 bytes} [Wed Oct 12 04:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:35.591072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b99c8-c642-4c63-8f51-059070fa6801 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:35.591394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b99c8-c642-4c63-8f51-059070fa6801 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:35.591676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b99c8-c642-4c63-8f51-059070fa6801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:35.609352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:35.670600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-dd2b99c8-c642-4c63-8f51-059070fa6801 None None] MFA Rules not processed for user `c894579b2b2943409412afbbfe779aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:35.671858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-dd2b99c8-c642-4c63-8f51-059070fa6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:35.746582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 538/1067] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Oct 12 04:42:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:35.756452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1cfb4-f984-417b-beea-a8c874369af5 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:35.757945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-aed1cfb4-f984-417b-beea-a8c874369af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:35.860431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1cfb4-f984-417b-beea-a8c874369af5 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:35.919961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:35.936974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f24285-5f60-4309-9cbc-b8ac37ac51de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c894579b2b2943409412afbbfe779aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:35.937586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f24285-5f60-4309-9cbc-b8ac37ac51de service glance] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:35.937865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f24285-5f60-4309-9cbc-b8ac37ac51de service glance] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:35.938138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f24285-5f60-4309-9cbc-b8ac37ac51de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:35.939796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-58f24285-5f60-4309-9cbc-b8ac37ac51de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:36.051391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f24285-5f60-4309-9cbc-b8ac37ac51de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:36.052836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f24285-5f60-4309-9cbc-b8ac37ac51de service glance] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:36.079620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 530/1068] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:36.538482 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618467c6-45b8-413c-b4c0-550164bb980d None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:36.539039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618467c6-45b8-413c-b4c0-550164bb980d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:36.539039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618467c6-45b8-413c-b4c0-550164bb980d None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:36.540340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 539/1069] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:36.545759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825bca-7676-4420-9c96-a526aeafb4e9 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:36.546216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825bca-7676-4420-9c96-a526aeafb4e9 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:36.546322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825bca-7676-4420-9c96-a526aeafb4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:36.619106 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e6825bca-7676-4420-9c96-a526aeafb4e9 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:36.620357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e6825bca-7676-4420-9c96-a526aeafb4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:36.675037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:36.732941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 531/1070] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:42:36.822844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf319bbc-fcbe-4049-a922-4c7aac243366 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:36.823225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf319bbc-fcbe-4049-a922-4c7aac243366 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:36.823658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf319bbc-fcbe-4049-a922-4c7aac243366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:36.890197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-cf319bbc-fcbe-4049-a922-4c7aac243366 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:36.891437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cf319bbc-fcbe-4049-a922-4c7aac243366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:36.945915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:36.978829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 540/1071] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:42:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:42:37.021656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734294a-9de5-48eb-bc89-7f9115f7879d None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:37.022026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734294a-9de5-48eb-bc89-7f9115f7879d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:37.022376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734294a-9de5-48eb-bc89-7f9115f7879d None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:37.023329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf319bbc-fcbe-4049-a922-4c7aac243366 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:37.023996 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 532/1072] 10.222.0.18 () {54 vars in 943 bytes} [Wed Oct 12 04:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:37.024607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cf319bbc-fcbe-4049-a922-4c7aac243366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:37.030405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10524b7e-cec8-4a25-bce3-b1e6025854a6 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:37.030697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10524b7e-cec8-4a25-bce3-b1e6025854a6 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:37.030977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10524b7e-cec8-4a25-bce3-b1e6025854a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:37.110045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-10524b7e-cec8-4a25-bce3-b1e6025854a6 None None] MFA Rules not processed for user `bf5efddd82994140a5f07c926375d477`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:37.111764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-10524b7e-cec8-4a25-bce3-b1e6025854a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:37.136863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf319bbc-fcbe-4049-a922-4c7aac243366 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:37.218398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:37.220352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 533/1073] 10.222.0.18 () {58 vars in 1040 bytes} [Wed Oct 12 04:42:37 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:42:37.230201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10524b7e-cec8-4a25-bce3-b1e6025854a6 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:37.235183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:37.242270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10524b7e-cec8-4a25-bce3-b1e6025854a6 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:37.256377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef387-ee2d-4279-9648-60274526e8bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:37.256992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef387-ee2d-4279-9648-60274526e8bd service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:37.257269 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef387-ee2d-4279-9648-60274526e8bd service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:37.257537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef387-ee2d-4279-9648-60274526e8bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:37.259415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f0aef387-ee2d-4279-9648-60274526e8bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:37.348455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fde5b-bd25-46a5-a0e3-89fe1ba836f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:37.349073 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fde5b-bd25-46a5-a0e3-89fe1ba836f8 service swift] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:37.349353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fde5b-bd25-46a5-a0e3-89fe1ba836f8 service swift] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:37.349625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fde5b-bd25-46a5-a0e3-89fe1ba836f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:37.351260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-916fde5b-bd25-46a5-a0e3-89fe1ba836f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:37.353542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef387-ee2d-4279-9648-60274526e8bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:37.355119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef387-ee2d-4279-9648-60274526e8bd service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:37.373823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 541/1074] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:42:37.443381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fde5b-bd25-46a5-a0e3-89fe1ba836f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:37.445036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fde5b-bd25-46a5-a0e3-89fe1ba836f8 service swift] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:37.454273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 534/1075] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:42:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 04:42:39.577537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e63cd-71e1-4a03-a284-1b0f877961d7 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:39.578122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e63cd-71e1-4a03-a284-1b0f877961d7 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:39.578122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e63cd-71e1-4a03-a284-1b0f877961d7 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:39.583780 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 542/1076] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:39.585431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9149-f360-4dc6-94c4-2c4b436eb0c3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:39.585873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9149-f360-4dc6-94c4-2c4b436eb0c3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:39.585965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9149-f360-4dc6-94c4-2c4b436eb0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:39.634293 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:39.675614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6e6f9149-f360-4dc6-94c4-2c4b436eb0c3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:39.677201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6e6f9149-f360-4dc6-94c4-2c4b436eb0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:39.793628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 535/1077] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:40.083449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e63cd-71e1-4a03-a284-1b0f877961d7 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:40.085235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3e8e63cd-71e1-4a03-a284-1b0f877961d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:40.185466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:40.250974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e63cd-71e1-4a03-a284-1b0f877961d7 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:40.406378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3e059-d4ec-40fe-81f9-54ce50cdb300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:40.407000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3e059-d4ec-40fe-81f9-54ce50cdb300 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:40.407933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3e059-d4ec-40fe-81f9-54ce50cdb300 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:40.408278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3e059-d4ec-40fe-81f9-54ce50cdb300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:40.409961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-afa3e059-d4ec-40fe-81f9-54ce50cdb300 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:40.475342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:40.514641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3e059-d4ec-40fe-81f9-54ce50cdb300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:40.516384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3e059-d4ec-40fe-81f9-54ce50cdb300 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:40.535054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 543/1078] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:42.747860 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde63b-9566-4c25-967c-9ec37095ce9d None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:42.748420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde63b-9566-4c25-967c-9ec37095ce9d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:42.748420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde63b-9566-4c25-967c-9ec37095ce9d None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:42.749728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 536/1079] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:42.755410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693c5ba-6822-4c87-9d6b-6fafa16a5103 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:42.755845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693c5ba-6822-4c87-9d6b-6fafa16a5103 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:42.755955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693c5ba-6822-4c87-9d6b-6fafa16a5103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:42.829726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-5693c5ba-6822-4c87-9d6b-6fafa16a5103 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:42.831027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5693c5ba-6822-4c87-9d6b-6fafa16a5103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:42.943345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 544/1080] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:43.220843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cde63b-9566-4c25-967c-9ec37095ce9d None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:43.222378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-54cde63b-9566-4c25-967c-9ec37095ce9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:43.340847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:43.389145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cde63b-9566-4c25-967c-9ec37095ce9d None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:43.510417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcc931-1ca2-410b-82f5-a409f5699829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:43.511043 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcc931-1ca2-410b-82f5-a409f5699829 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:43.511351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcc931-1ca2-410b-82f5-a409f5699829 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:43.511631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcc931-1ca2-410b-82f5-a409f5699829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:43.513270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4bfcc931-1ca2-410b-82f5-a409f5699829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:43.593977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:43.614357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcc931-1ca2-410b-82f5-a409f5699829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:43.616120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcc931-1ca2-410b-82f5-a409f5699829 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:43.636627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 537/1081] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:45.863675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b338-6648-4826-a789-759757a1c0a0 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:45.864528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b338-6648-4826-a789-759757a1c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:45.864805 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b338-6648-4826-a789-759757a1c0a0 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:45.866231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 545/1082] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:42:45.871941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d353-9c3b-44a3-a2c3-2dc0d6725395 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:45.872832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d353-9c3b-44a3-a2c3-2dc0d6725395 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:45.873330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d353-9c3b-44a3-a2c3-2dc0d6725395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:45.948351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-91c4d353-9c3b-44a3-a2c3-2dc0d6725395 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:42:45.949580 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-91c4d353-9c3b-44a3-a2c3-2dc0d6725395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:46.067334 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 538/1083] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:42:46.351509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b338-6648-4826-a789-759757a1c0a0 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:42:46.353035 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0c49b338-6648-4826-a789-759757a1c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:46.393563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:46.518682 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b338-6648-4826-a789-759757a1c0a0 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:42:46.644697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:46.653250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7893f-3139-4a5d-82cf-2ed6f285ed7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:42:46.654044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7893f-3139-4a5d-82cf-2ed6f285ed7e service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:42:46.654334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7893f-3139-4a5d-82cf-2ed6f285ed7e service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:42:46.654614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7893f-3139-4a5d-82cf-2ed6f285ed7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:42:46.656423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-7cf7893f-3139-4a5d-82cf-2ed6f285ed7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:42:46.770267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7893f-3139-4a5d-82cf-2ed6f285ed7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:42:46.772222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7893f-3139-4a5d-82cf-2ed6f285ed7e service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:42:46.793910 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 546/1084] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:42:56.061406 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=79 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:42:56.791255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=48 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:00.078416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89847c80-fac0-4d7b-a00c-c860ac59c4e0 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:00.078992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89847c80-fac0-4d7b-a00c-c860ac59c4e0 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:00.078992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89847c80-fac0-4d7b-a00c-c860ac59c4e0 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:00.080352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 539/1085] 10.222.0.18 () {54 vars in 918 bytes} [Wed Oct 12 04:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:00.085549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b6ec-a7a3-4039-9aae-332fb265a838 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:00.085952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b6ec-a7a3-4039-9aae-332fb265a838 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:00.086098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b6ec-a7a3-4039-9aae-332fb265a838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:00.163420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a6e4b6ec-a7a3-4039-9aae-332fb265a838 None None] MFA Rules not processed for user `332a44161d204223983ed2aa3aef9317`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:00.164633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a6e4b6ec-a7a3-4039-9aae-332fb265a838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:00.268721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 547/1086] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Oct 12 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:00.283299 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dbbf9-21cb-4a6c-9524-a1f38db207ba None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:00.283597 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dbbf9-21cb-4a6c-9524-a1f38db207ba None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:00.283876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dbbf9-21cb-4a6c-9524-a1f38db207ba None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:00.285222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 540/1087] 10.222.0.18 () {54 vars in 918 bytes} [Wed Oct 12 04:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:00.289633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a32666-ae34-41e1-8175-b60c850e9c8c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:00.289918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a32666-ae34-41e1-8175-b60c850e9c8c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:00.290192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a32666-ae34-41e1-8175-b60c850e9c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:00.362175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:00.364728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-32a32666-ae34-41e1-8175-b60c850e9c8c None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:00.366520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-32a32666-ae34-41e1-8175-b60c850e9c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:00.479144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 548/1088] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Oct 12 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:03.030493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0d34-5498-4d89-95bc-861cb6c5178d None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:03.031603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0d34-5498-4d89-95bc-861cb6c5178d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:03.031603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0d34-5498-4d89-95bc-861cb6c5178d None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:03.032939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 541/1089] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:03.038463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5ff4d-882d-4e8e-a881-ea05ab716a65 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:03.038893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5ff4d-882d-4e8e-a881-ea05ab716a65 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:03.039003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5ff4d-882d-4e8e-a881-ea05ab716a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:03.104395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-f5b5ff4d-882d-4e8e-a881-ea05ab716a65 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:03.105580 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f5b5ff4d-882d-4e8e-a881-ea05ab716a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:03.158897 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:03.200317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 549/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:03.490022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf0d34-5498-4d89-95bc-861cb6c5178d None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:03.491609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-00cf0d34-5498-4d89-95bc-861cb6c5178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:03.635742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf0d34-5498-4d89-95bc-861cb6c5178d None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:03.707444 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:03.749445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22196b91-54c8-4ced-9996-cbf046b6ff2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:03.750028 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196b91-54c8-4ced-9996-cbf046b6ff2b service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:03.750306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196b91-54c8-4ced-9996-cbf046b6ff2b service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:03.750577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196b91-54c8-4ced-9996-cbf046b6ff2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:03.752226 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-22196b91-54c8-4ced-9996-cbf046b6ff2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:03.840044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22196b91-54c8-4ced-9996-cbf046b6ff2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:03.841628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22196b91-54c8-4ced-9996-cbf046b6ff2b service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:03.860172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 542/1091] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:04.988236 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2345b5-c517-4815-be58-5a4ce441a0b6 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:04.988785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2345b5-c517-4815-be58-5a4ce441a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:04.988785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2345b5-c517-4815-be58-5a4ce441a0b6 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:04.990148 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 550/1092] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:04.996463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149cef5-8bb0-4548-ad26-e3e5f76d6dc5 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:04.996864 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149cef5-8bb0-4548-ad26-e3e5f76d6dc5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:04.997017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149cef5-8bb0-4548-ad26-e3e5f76d6dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:05.072119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5149cef5-8bb0-4548-ad26-e3e5f76d6dc5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:05.073320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5149cef5-8bb0-4548-ad26-e3e5f76d6dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:05.100597 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:05.168621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 543/1093] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:05.316228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2345b5-c517-4815-be58-5a4ce441a0b6 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:05.317652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-7d2345b5-c517-4815-be58-5a4ce441a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:05.459875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2345b5-c517-4815-be58-5a4ce441a0b6 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:05.498170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:05.573404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d4a3b-ddfe-46ae-bc3f-82dc51409815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:05.573940 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4a3b-ddfe-46ae-bc3f-82dc51409815 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:05.574223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4a3b-ddfe-46ae-bc3f-82dc51409815 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:05.574498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4a3b-ddfe-46ae-bc3f-82dc51409815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:05.576121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-776d4a3b-ddfe-46ae-bc3f-82dc51409815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:05.663686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d4a3b-ddfe-46ae-bc3f-82dc51409815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:05.665281 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d4a3b-ddfe-46ae-bc3f-82dc51409815 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:05.683224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 551/1094] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:06.799497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b6f4b-562d-40cc-8d5c-19c990544a4e None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:06.800058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b6f4b-562d-40cc-8d5c-19c990544a4e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:06.800058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b6f4b-562d-40cc-8d5c-19c990544a4e None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:06.801388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 544/1095] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:06.807846 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef490b7-cc5e-4ab7-8d3f-2384f32d19be None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:06.808310 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef490b7-cc5e-4ab7-8d3f-2384f32d19be None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:06.808409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef490b7-cc5e-4ab7-8d3f-2384f32d19be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:06.863015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:06.884958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-0ef490b7-cc5e-4ab7-8d3f-2384f32d19be None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:06.886163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0ef490b7-cc5e-4ab7-8d3f-2384f32d19be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:06.980419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 552/1096] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:07.133021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b6f4b-562d-40cc-8d5c-19c990544a4e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:07.134472 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-738b6f4b-562d-40cc-8d5c-19c990544a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:07.278340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b6f4b-562d-40cc-8d5c-19c990544a4e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:07.290262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:07.390451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8b69e-fdb3-4528-ae5e-5b5035d8d5c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:07.390983 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b69e-fdb3-4528-ae5e-5b5035d8d5c6 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:07.391267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b69e-fdb3-4528-ae5e-5b5035d8d5c6 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:07.391573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b69e-fdb3-4528-ae5e-5b5035d8d5c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:07.393165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-71f8b69e-fdb3-4528-ae5e-5b5035d8d5c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:07.482037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8b69e-fdb3-4528-ae5e-5b5035d8d5c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:07.483654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8b69e-fdb3-4528-ae5e-5b5035d8d5c6 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:07.501646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 545/1097] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:08.603735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc685b2-9ddb-4da9-8ff5-0f4755ba13aa None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:08.604169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc685b2-9ddb-4da9-8ff5-0f4755ba13aa None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:08.604291 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc685b2-9ddb-4da9-8ff5-0f4755ba13aa None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:08.605642 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 553/1098] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:08.612301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750f38-28b3-4a77-9846-fd006795b6a2 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:08.612740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750f38-28b3-4a77-9846-fd006795b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:08.612856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750f38-28b3-4a77-9846-fd006795b6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:08.633032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:08.687939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-dd750f38-28b3-4a77-9846-fd006795b6a2 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:08.689126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dd750f38-28b3-4a77-9846-fd006795b6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:08.783025 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 546/1099] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:08.933285 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc685b2-9ddb-4da9-8ff5-0f4755ba13aa None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:08.934745 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bcc685b2-9ddb-4da9-8ff5-0f4755ba13aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:09.042186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:09.078585 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc685b2-9ddb-4da9-8ff5-0f4755ba13aa None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:09.188754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd056d-15ac-4112-a153-fa0a97888e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:09.189280 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd056d-15ac-4112-a153-fa0a97888e44 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:09.189557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd056d-15ac-4112-a153-fa0a97888e44 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:09.189828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd056d-15ac-4112-a153-fa0a97888e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:09.191433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e3fd056d-15ac-4112-a153-fa0a97888e44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:09.265530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:09.278757 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd056d-15ac-4112-a153-fa0a97888e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:09.280370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd056d-15ac-4112-a153-fa0a97888e44 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:09.298067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 554/1100] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:10.402503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb37e2-6521-44f7-a5c7-f31337c91dec None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:10.403080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb37e2-6521-44f7-a5c7-f31337c91dec None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:10.403080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb37e2-6521-44f7-a5c7-f31337c91dec None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:10.404438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 547/1101] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:10.410827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ef406-ede0-423b-b023-c6f6ccc5ecca None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:10.411276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ef406-ede0-423b-b023-c6f6ccc5ecca None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:10.411538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ef406-ede0-423b-b023-c6f6ccc5ecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:10.487541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-378ef406-ede0-423b-b023-c6f6ccc5ecca None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:10.488746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-378ef406-ede0-423b-b023-c6f6ccc5ecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:10.583414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 555/1102] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:10.734121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb37e2-6521-44f7-a5c7-f31337c91dec None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:10.735670 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-44cb37e2-6521-44f7-a5c7-f31337c91dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:10.816709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:10.876818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb37e2-6521-44f7-a5c7-f31337c91dec None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:10.986457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de869a-449c-465a-8fc5-e34cf0c6ca37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:10.987064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de869a-449c-465a-8fc5-e34cf0c6ca37 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:10.987391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de869a-449c-465a-8fc5-e34cf0c6ca37 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:10.987723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de869a-449c-465a-8fc5-e34cf0c6ca37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:10.989317 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-42de869a-449c-465a-8fc5-e34cf0c6ca37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:11.038015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:11.080635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de869a-449c-465a-8fc5-e34cf0c6ca37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:11.082478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de869a-449c-465a-8fc5-e34cf0c6ca37 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:11.100640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 548/1103] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:12.151445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16e28d-17dc-4265-b3ad-f7dac34b9f39 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:12.152012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16e28d-17dc-4265-b3ad-f7dac34b9f39 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:12.152012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16e28d-17dc-4265-b3ad-f7dac34b9f39 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:12.153266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 556/1104] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:12.159887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c5e4a-952e-410c-8f8d-1960de3c580c None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:12.160354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c5e4a-952e-410c-8f8d-1960de3c580c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:12.160542 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c5e4a-952e-410c-8f8d-1960de3c580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:12.236233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b54c5e4a-952e-410c-8f8d-1960de3c580c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:12.237441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b54c5e4a-952e-410c-8f8d-1960de3c580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:12.333249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 549/1105] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:12.485535 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16e28d-17dc-4265-b3ad-f7dac34b9f39 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:12.487080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ee16e28d-17dc-4265-b3ad-f7dac34b9f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:12.534926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:12.630415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16e28d-17dc-4265-b3ad-f7dac34b9f39 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:12.739562 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d2f26-3a85-460d-9675-39d70ba14502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:12.740087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d2f26-3a85-460d-9675-39d70ba14502 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:12.740368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d2f26-3a85-460d-9675-39d70ba14502 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:12.740643 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d2f26-3a85-460d-9675-39d70ba14502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:12.742223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cf2d2f26-3a85-460d-9675-39d70ba14502 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:12.748930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:12.830574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d2f26-3a85-460d-9675-39d70ba14502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:12.832450 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d2f26-3a85-460d-9675-39d70ba14502 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:12.849526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 557/1106] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:13.893230 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6791c9-f682-4b82-ab9f-9d970e26136d None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:13.893860 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6791c9-f682-4b82-ab9f-9d970e26136d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:13.893860 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6791c9-f682-4b82-ab9f-9d970e26136d None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:13.895021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 550/1107] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:13.901401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bf196-59b3-4ba5-a8d2-a94f6246ac8e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:13.901820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bf196-59b3-4ba5-a8d2-a94f6246ac8e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:13.901959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bf196-59b3-4ba5-a8d2-a94f6246ac8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:13.976509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-616bf196-59b3-4ba5-a8d2-a94f6246ac8e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:13.977721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-616bf196-59b3-4ba5-a8d2-a94f6246ac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:14.043177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:14.071610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 558/1108] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:14.224154 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6791c9-f682-4b82-ab9f-9d970e26136d None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:14.225672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-7a6791c9-f682-4b82-ab9f-9d970e26136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:14.242735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:14.368032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6791c9-f682-4b82-ab9f-9d970e26136d None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:14.453174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:14.478114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e326b-a197-4975-9551-5002e795dd3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:14.478659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e326b-a197-4975-9551-5002e795dd3e service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:14.478939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e326b-a197-4975-9551-5002e795dd3e service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:14.479210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e326b-a197-4975-9551-5002e795dd3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:14.480818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fd4e326b-a197-4975-9551-5002e795dd3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:14.574127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e326b-a197-4975-9551-5002e795dd3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:14.575754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e326b-a197-4975-9551-5002e795dd3e service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:14.593858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 551/1109] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:15.654793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a3c7-afba-4f9f-bb2d-e021b61887de None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:15.655342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a3c7-afba-4f9f-bb2d-e021b61887de None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:15.655452 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a3c7-afba-4f9f-bb2d-e021b61887de None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:15.656770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 559/1110] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:15.663117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66438b0d-baac-4609-9879-799303d0d442 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:15.663579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66438b0d-baac-4609-9879-799303d0d442 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:15.663724 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66438b0d-baac-4609-9879-799303d0d442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:15.738201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-66438b0d-baac-4609-9879-799303d0d442 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:15.739426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-66438b0d-baac-4609-9879-799303d0d442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:15.780312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:15.834677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 552/1111] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:43:15.985510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98a3c7-afba-4f9f-bb2d-e021b61887de None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:15.987029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-7b98a3c7-afba-4f9f-bb2d-e021b61887de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:16.131035 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98a3c7-afba-4f9f-bb2d-e021b61887de None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:16.183800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:16.242093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373467b-3818-47a3-8342-6590d29cb8ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:16.242696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373467b-3818-47a3-8342-6590d29cb8ff service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:16.242978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373467b-3818-47a3-8342-6590d29cb8ff service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:16.243256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373467b-3818-47a3-8342-6590d29cb8ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:16.244888 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-7373467b-3818-47a3-8342-6590d29cb8ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:16.335520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373467b-3818-47a3-8342-6590d29cb8ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:16.337110 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373467b-3818-47a3-8342-6590d29cb8ff service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:16.355159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 560/1112] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:17.400965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee90eb-dffe-4424-ab5f-17309cacfb5d None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:17.401552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee90eb-dffe-4424-ab5f-17309cacfb5d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:17.401552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee90eb-dffe-4424-ab5f-17309cacfb5d None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:17.402831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 553/1113] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:17.408857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d74e-29dc-4f6a-8d31-0b256776a128 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:17.409247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d74e-29dc-4f6a-8d31-0b256776a128 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:17.409411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d74e-29dc-4f6a-8d31-0b256776a128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:17.483573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-efa2d74e-29dc-4f6a-8d31-0b256776a128 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:17.484758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-efa2d74e-29dc-4f6a-8d31-0b256776a128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:17.486701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:17.583870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 561/1114] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:17.731711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee90eb-dffe-4424-ab5f-17309cacfb5d None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:17.733747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-cfee90eb-dffe-4424-ab5f-17309cacfb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:17.876217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee90eb-dffe-4424-ab5f-17309cacfb5d None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:17.903639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:17.988397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624784a2-3aff-4232-b5ec-6f9fcd0e36f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:17.988921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624784a2-3aff-4232-b5ec-6f9fcd0e36f5 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:17.989196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624784a2-3aff-4232-b5ec-6f9fcd0e36f5 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:17.989467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624784a2-3aff-4232-b5ec-6f9fcd0e36f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:17.991037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-624784a2-3aff-4232-b5ec-6f9fcd0e36f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:18.077327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624784a2-3aff-4232-b5ec-6f9fcd0e36f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:18.078900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624784a2-3aff-4232-b5ec-6f9fcd0e36f5 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:18.097050 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 554/1115] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:20.137237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfa55a-7b0f-424a-8f83-e755d2e9472b None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:20.137802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfa55a-7b0f-424a-8f83-e755d2e9472b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:20.137802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfa55a-7b0f-424a-8f83-e755d2e9472b None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:20.139144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 562/1116] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:20.144548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e25697-4d26-401e-a8b3-8f58c9f2e4a3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:20.144946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e25697-4d26-401e-a8b3-8f58c9f2e4a3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:20.145103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e25697-4d26-401e-a8b3-8f58c9f2e4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:20.186168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:20.212074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-85e25697-4d26-401e-a8b3-8f58c9f2e4a3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:20.213254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-85e25697-4d26-401e-a8b3-8f58c9f2e4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:20.310258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 555/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:20.605990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7439b-375d-4df4-9f83-a98e1b8a7582 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:20.606276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7439b-375d-4df4-9f83-a98e1b8a7582 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:20.606555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7439b-375d-4df4-9f83-a98e1b8a7582 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:20.608022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 563/1118] 10.222.0.18 () {54 vars in 964 bytes} [Wed Oct 12 04:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:20.614065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88817c-4206-43c6-8a33-8a49e2aa4f61 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:20.614352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88817c-4206-43c6-8a33-8a49e2aa4f61 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:20.614626 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88817c-4206-43c6-8a33-8a49e2aa4f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:20.690292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ab88817c-4206-43c6-8a33-8a49e2aa4f61 None None] MFA Rules not processed for user `dc59d3cc1fbc4d4382bffd8ae93075e1`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:20.691530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ab88817c-4206-43c6-8a33-8a49e2aa4f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:20.742510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:20.766749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 556/1119] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Oct 12 04:43:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:20.775830 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7439b-375d-4df4-9f83-a98e1b8a7582 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:20.777371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b7f7439b-375d-4df4-9f83-a98e1b8a7582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:20.879881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7439b-375d-4df4-9f83-a98e1b8a7582 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:20.911626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:20.953136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84096897-4d46-4ed6-b1ec-9c02d43bbde6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:20.953735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84096897-4d46-4ed6-b1ec-9c02d43bbde6 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:20.954016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84096897-4d46-4ed6-b1ec-9c02d43bbde6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:20.954290 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84096897-4d46-4ed6-b1ec-9c02d43bbde6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:20.956171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-84096897-4d46-4ed6-b1ec-9c02d43bbde6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:21.062850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84096897-4d46-4ed6-b1ec-9c02d43bbde6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:21.064541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84096897-4d46-4ed6-b1ec-9c02d43bbde6 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:21.083767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 564/1120] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:43:23.772286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd063-8a37-4174-b2c9-f0fe7d7666f8 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:23.772839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd063-8a37-4174-b2c9-f0fe7d7666f8 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:23.772839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd063-8a37-4174-b2c9-f0fe7d7666f8 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:23.774190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 557/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:23.779336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a2ce-1dea-4c9d-9315-e63691846ae8 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:23.780344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a2ce-1dea-4c9d-9315-e63691846ae8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:23.780494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a2ce-1dea-4c9d-9315-e63691846ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:23.845104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-9ef9a2ce-1dea-4c9d-9315-e63691846ae8 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:23.846219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9ef9a2ce-1dea-4c9d-9315-e63691846ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:23.858651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:23.942716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 565/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:24.232655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd063-8a37-4174-b2c9-f0fe7d7666f8 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:24.234197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-997cd063-8a37-4174-b2c9-f0fe7d7666f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:24.339403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd063-8a37-4174-b2c9-f0fe7d7666f8 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:24.410661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909dd0d-61d2-45c9-be83-e202a4f821fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:24.411261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909dd0d-61d2-45c9-be83-e202a4f821fd service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:24.411576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909dd0d-61d2-45c9-be83-e202a4f821fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:24.411853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909dd0d-61d2-45c9-be83-e202a4f821fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:24.413441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4909dd0d-61d2-45c9-be83-e202a4f821fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:24.444759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:24.522364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909dd0d-61d2-45c9-be83-e202a4f821fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:24.523766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909dd0d-61d2-45c9-be83-e202a4f821fd service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:24.541272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 558/1123] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:27.063038 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e2e13-3369-42a4-aca1-c55f066a237e None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:27.063613 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e2e13-3369-42a4-aca1-c55f066a237e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:27.063613 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e2e13-3369-42a4-aca1-c55f066a237e None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:27.064973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 566/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:27.070681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ea10-dfa0-4a78-8f15-69227a1bd247 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:27.071105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ea10-dfa0-4a78-8f15-69227a1bd247 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:27.071263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ea10-dfa0-4a78-8f15-69227a1bd247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:27.136712 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0e61ea10-dfa0-4a78-8f15-69227a1bd247 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:27.137910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0e61ea10-dfa0-4a78-8f15-69227a1bd247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:27.213730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:27.233312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 559/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:43:27.512059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e2e13-3369-42a4-aca1-c55f066a237e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:27.513607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-115e2e13-3369-42a4-aca1-c55f066a237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:27.614992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e2e13-3369-42a4-aca1-c55f066a237e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:27.654956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:27.688569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8ea67-df0a-4a1a-84a2-fd0f1f882e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:27.689178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8ea67-df0a-4a1a-84a2-fd0f1f882e2c service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:27.689458 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8ea67-df0a-4a1a-84a2-fd0f1f882e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:27.689734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8ea67-df0a-4a1a-84a2-fd0f1f882e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:27.691334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-42f8ea67-df0a-4a1a-84a2-fd0f1f882e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:27.798667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8ea67-df0a-4a1a-84a2-fd0f1f882e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:27.800081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8ea67-df0a-4a1a-84a2-fd0f1f882e2c service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:27.818256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 567/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:30.086524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5470f9-78b0-458a-aaa2-f283a926ca19 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:30.087094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5470f9-78b0-458a-aaa2-f283a926ca19 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:30.087094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5470f9-78b0-458a-aaa2-f283a926ca19 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:30.088447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 560/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:30.094221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5f21-6c66-42c2-a884-fd5ec49607d2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:30.094606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5f21-6c66-42c2-a884-fd5ec49607d2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:30.094826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5f21-6c66-42c2-a884-fd5ec49607d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:30.159970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8cfb5f21-6c66-42c2-a884-fd5ec49607d2 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:30.161168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8cfb5f21-6c66-42c2-a884-fd5ec49607d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:30.182320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:30.256935 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 568/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:30.538401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5470f9-78b0-458a-aaa2-f283a926ca19 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:30.539976 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bd5470f9-78b0-458a-aaa2-f283a926ca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:30.642703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5470f9-78b0-458a-aaa2-f283a926ca19 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:30.715386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f465ce-8f81-48e2-8dce-26b5e9b21fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:30.715997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f465ce-8f81-48e2-8dce-26b5e9b21fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:30.716277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f465ce-8f81-48e2-8dce-26b5e9b21fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:30.716550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f465ce-8f81-48e2-8dce-26b5e9b21fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:30.718136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-26f465ce-8f81-48e2-8dce-26b5e9b21fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:30.756562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:30.824451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f465ce-8f81-48e2-8dce-26b5e9b21fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:30.825805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f465ce-8f81-48e2-8dce-26b5e9b21fc4 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:30.844553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 561/1129] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:33.042790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79dda-0d35-4789-bba3-bfd08e0f66e1 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:33.043379 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79dda-0d35-4789-bba3-bfd08e0f66e1 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:33.043379 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79dda-0d35-4789-bba3-bfd08e0f66e1 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:33.044756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 569/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:33.050245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9bcee-5ce4-4ccf-b518-31c3e86d3898 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:33.050645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9bcee-5ce4-4ccf-b518-31c3e86d3898 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:33.050811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9bcee-5ce4-4ccf-b518-31c3e86d3898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:33.116198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-33e9bcee-5ce4-4ccf-b518-31c3e86d3898 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:33.117400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-33e9bcee-5ce4-4ccf-b518-31c3e86d3898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:33.207621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:33.214144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 562/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:33.496482 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a79dda-0d35-4789-bba3-bfd08e0f66e1 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:33.498651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-50a79dda-0d35-4789-bba3-bfd08e0f66e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:33.599017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a79dda-0d35-4789-bba3-bfd08e0f66e1 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:33.650020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:33.675621 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491e29d-8718-45f8-afc8-9c741bbfe15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:33.676228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491e29d-8718-45f8-afc8-9c741bbfe15e service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:33.676510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491e29d-8718-45f8-afc8-9c741bbfe15e service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:33.676788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491e29d-8718-45f8-afc8-9c741bbfe15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:33.678382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d491e29d-8718-45f8-afc8-9c741bbfe15e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:33.790650 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491e29d-8718-45f8-afc8-9c741bbfe15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:33.792047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491e29d-8718-45f8-afc8-9c741bbfe15e service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:33.811475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 570/1132] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:36.063873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769e8d6-643b-40bc-af2c-be21542cc564 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:36.064410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769e8d6-643b-40bc-af2c-be21542cc564 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:36.064410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769e8d6-643b-40bc-af2c-be21542cc564 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:36.065765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 563/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:36.071135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1d94-8dd1-47a5-9e0b-70d60e454375 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:36.071566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1d94-8dd1-47a5-9e0b-70d60e454375 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:36.071725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1d94-8dd1-47a5-9e0b-70d60e454375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:36.138059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b1ba1d94-8dd1-47a5-9e0b-70d60e454375 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:36.139342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b1ba1d94-8dd1-47a5-9e0b-70d60e454375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:36.167587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:36.234026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 571/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:36.521518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769e8d6-643b-40bc-af2c-be21542cc564 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:36.523051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5769e8d6-643b-40bc-af2c-be21542cc564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:36.626904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769e8d6-643b-40bc-af2c-be21542cc564 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:36.702404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd35171-4cd2-44b5-813e-58078e9af859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:36.703013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd35171-4cd2-44b5-813e-58078e9af859 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:36.703327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd35171-4cd2-44b5-813e-58078e9af859 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:36.703664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd35171-4cd2-44b5-813e-58078e9af859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:36.705553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9dd35171-4cd2-44b5-813e-58078e9af859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:36.752638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:36.811656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd35171-4cd2-44b5-813e-58078e9af859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:36.812985 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd35171-4cd2-44b5-813e-58078e9af859 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:36.831797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 564/1135] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:39.033479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a596bb-a63c-4651-9a48-12d0d8debdb6 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:39.034013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a596bb-a63c-4651-9a48-12d0d8debdb6 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:39.034013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a596bb-a63c-4651-9a48-12d0d8debdb6 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:39.035414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 572/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:39.040668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ab74-1e29-4150-8554-222583688a51 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:39.041097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ab74-1e29-4150-8554-222583688a51 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:39.041228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ab74-1e29-4150-8554-222583688a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:39.105874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-a873ab74-1e29-4150-8554-222583688a51 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:39.107653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a873ab74-1e29-4150-8554-222583688a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:39.201555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 565/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:39.484795 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a596bb-a63c-4651-9a48-12d0d8debdb6 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:39.486333 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-14a596bb-a63c-4651-9a48-12d0d8debdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:39.588612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a596bb-a63c-4651-9a48-12d0d8debdb6 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:39.650702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:39.669317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e230bf-f909-4cff-8c26-fd95916fe5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:39.670157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e230bf-f909-4cff-8c26-fd95916fe5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:39.670441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e230bf-f909-4cff-8c26-fd95916fe5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:39.670717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e230bf-f909-4cff-8c26-fd95916fe5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:39.672357 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-73e230bf-f909-4cff-8c26-fd95916fe5c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:39.781702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e230bf-f909-4cff-8c26-fd95916fe5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:39.783093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e230bf-f909-4cff-8c26-fd95916fe5c2 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:39.800823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 573/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:41.993126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd478972-50f9-49b6-9ce6-4767f2e3fab7 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:41.993776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd478972-50f9-49b6-9ce6-4767f2e3fab7 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:41.993776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd478972-50f9-49b6-9ce6-4767f2e3fab7 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:41.995074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 566/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:42.000831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf6944-8c48-4e55-bb46-f658d6ee123f None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:42.001294 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf6944-8c48-4e55-bb46-f658d6ee123f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:42.001399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf6944-8c48-4e55-bb46-f658d6ee123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:42.068571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-0dbf6944-8c48-4e55-bb46-f658d6ee123f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:42.069781 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0dbf6944-8c48-4e55-bb46-f658d6ee123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:42.107989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:42.165270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 574/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:42.449968 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd478972-50f9-49b6-9ce6-4767f2e3fab7 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:42.451569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fd478972-50f9-49b6-9ce6-4767f2e3fab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:42.455685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:42.554650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd478972-50f9-49b6-9ce6-4767f2e3fab7 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:42.628076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6025ff2-dce0-48b5-ba72-1b85c6473c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:42.628618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6025ff2-dce0-48b5-ba72-1b85c6473c0d service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:42.628898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6025ff2-dce0-48b5-ba72-1b85c6473c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:42.629167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6025ff2-dce0-48b5-ba72-1b85c6473c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:42.630747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a6025ff2-dce0-48b5-ba72-1b85c6473c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:42.688526 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:42.738945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6025ff2-dce0-48b5-ba72-1b85c6473c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:42.740400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6025ff2-dce0-48b5-ba72-1b85c6473c0d service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:42.757819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 567/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:44.901887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cee75-468d-4e2e-bde4-f3c0ee7ed906 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:44.902434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cee75-468d-4e2e-bde4-f3c0ee7ed906 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:44.902434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cee75-468d-4e2e-bde4-f3c0ee7ed906 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:44.903758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 575/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:44.909582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14abd5f-b35e-4f65-a816-5a3716ac6b87 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:44.910007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14abd5f-b35e-4f65-a816-5a3716ac6b87 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:44.910141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14abd5f-b35e-4f65-a816-5a3716ac6b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:44.975022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e14abd5f-b35e-4f65-a816-5a3716ac6b87 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:44.976263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e14abd5f-b35e-4f65-a816-5a3716ac6b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:45.070873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 568/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:45.349954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cee75-468d-4e2e-bde4-f3c0ee7ed906 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:45.351570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c57cee75-468d-4e2e-bde4-f3c0ee7ed906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:45.452739 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cee75-468d-4e2e-bde4-f3c0ee7ed906 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:45.518578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:45.525360 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b2247-7944-4031-af70-7bc750c8fcec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:45.525968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b2247-7944-4031-af70-7bc750c8fcec service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:45.526252 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b2247-7944-4031-af70-7bc750c8fcec service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:45.526530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b2247-7944-4031-af70-7bc750c8fcec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:45.528156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b01b2247-7944-4031-af70-7bc750c8fcec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:45.635961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b2247-7944-4031-af70-7bc750c8fcec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:45.637324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b2247-7944-4031-af70-7bc750c8fcec service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:45.655310 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 576/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:47.801799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7fc74-ff28-4783-b6cf-25795d9242e4 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:47.802361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7fc74-ff28-4783-b6cf-25795d9242e4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:47.802361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7fc74-ff28-4783-b6cf-25795d9242e4 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:47.803773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 569/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:43:47.809109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa029458-5e3f-4a90-bc35-cdb5304cbd12 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:47.809514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa029458-5e3f-4a90-bc35-cdb5304cbd12 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:47.809651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa029458-5e3f-4a90-bc35-cdb5304cbd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:47.875644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-fa029458-5e3f-4a90-bc35-cdb5304cbd12 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:43:47.876746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fa029458-5e3f-4a90-bc35-cdb5304cbd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:47.924696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:47.972047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 577/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:43:48.258371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7fc74-ff28-4783-b6cf-25795d9242e4 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:43:48.259970 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bbb7fc74-ff28-4783-b6cf-25795d9242e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:48.274238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:48.362285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7fc74-ff28-4783-b6cf-25795d9242e4 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:43:48.436005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b083a02-ee71-4d32-9880-dcd5ac984e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:43:48.436543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b083a02-ee71-4d32-9880-dcd5ac984e19 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:43:48.436824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b083a02-ee71-4d32-9880-dcd5ac984e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:43:48.437124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b083a02-ee71-4d32-9880-dcd5ac984e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:43:48.438749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8b083a02-ee71-4d32-9880-dcd5ac984e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:43:48.505075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:48.545342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b083a02-ee71-4d32-9880-dcd5ac984e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:43:48.546763 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b083a02-ee71-4d32-9880-dcd5ac984e19 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:43:48.565265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 570/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:43:57.970534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=22 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:43:58.563035 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=25 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:08.336161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acd825-faf4-4f37-b658-8d145c23b09c None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:08.336663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acd825-faf4-4f37-b658-8d145c23b09c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:08.336779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acd825-faf4-4f37-b658-8d145c23b09c None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:08.338091 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 578/1148] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:44:08.343825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aab81-322e-41cd-80b7-2b48a29d4e35 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:08.344263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aab81-322e-41cd-80b7-2b48a29d4e35 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:08.344368 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aab81-322e-41cd-80b7-2b48a29d4e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:08.409411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-583aab81-322e-41cd-80b7-2b48a29d4e35 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:44:08.410619 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-583aab81-322e-41cd-80b7-2b48a29d4e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:08.506505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 571/1149] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:44:08.808031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20407-18f6-44f7-bf77-dbe007316547 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:08.808321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20407-18f6-44f7-bf77-dbe007316547 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:08.808599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20407-18f6-44f7-bf77-dbe007316547 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:08.809936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 579/1150] 10.222.0.18 () {54 vars in 962 bytes} [Wed Oct 12 04:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:44:08.815387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6949-52fe-4982-84d6-ea79eed16951 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:08.815728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6949-52fe-4982-84d6-ea79eed16951 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:08.816009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f6949-52fe-4982-84d6-ea79eed16951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:08.890830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ef6f6949-52fe-4982-84d6-ea79eed16951 None None] MFA Rules not processed for user `c894579b2b2943409412afbbfe779aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:44:08.891989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ef6f6949-52fe-4982-84d6-ea79eed16951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:08.912845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:08.967826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 572/1151] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Oct 12 04:44:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:44:08.975374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe20407-18f6-44f7-bf77-dbe007316547 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:44:08.976903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0fe20407-18f6-44f7-bf77-dbe007316547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:09.078237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe20407-18f6-44f7-bf77-dbe007316547 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:44:09.150537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8420a-3fef-4891-bb77-9770f6092588 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c894579b2b2943409412afbbfe779aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:44:09.151070 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8420a-3fef-4891-bb77-9770f6092588 service glance] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:09.151389 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8420a-3fef-4891-bb77-9770f6092588 service glance] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:09.151666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8420a-3fef-4891-bb77-9770f6092588 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:09.153251 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1de8420a-3fef-4891-bb77-9770f6092588 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:09.207266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:09.261295 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8420a-3fef-4891-bb77-9770f6092588 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:44:09.262707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8420a-3fef-4891-bb77-9770f6092588 service glance] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:44:09.281378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 580/1152] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:44:11.493529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cb3a8-fc76-43a1-9598-c1868eca9a7f None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:11.494004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cb3a8-fc76-43a1-9598-c1868eca9a7f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:11.494112 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cb3a8-fc76-43a1-9598-c1868eca9a7f None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:11.495445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 573/1153] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:44:11.501211 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a121d-25ba-4f62-9d87-400f9f77b014 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:11.501612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a121d-25ba-4f62-9d87-400f9f77b014 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:11.501772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a121d-25ba-4f62-9d87-400f9f77b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:11.566849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-666a121d-25ba-4f62-9d87-400f9f77b014 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:44:11.568011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-666a121d-25ba-4f62-9d87-400f9f77b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:11.665649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 581/1154] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:44:11.941668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cb3a8-fc76-43a1-9598-c1868eca9a7f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:44:11.943243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1a6cb3a8-fc76-43a1-9598-c1868eca9a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:12.065777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cb3a8-fc76-43a1-9598-c1868eca9a7f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:44:12.115541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:12.159781 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce351b-9245-4ee6-841f-0326d6c2ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:44:12.160389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce351b-9245-4ee6-841f-0326d6c2ff4b admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:12.160672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce351b-9245-4ee6-841f-0326d6c2ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:12.160947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce351b-9245-4ee6-841f-0326d6c2ff4b admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:12.161583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce351b-9245-4ee6-841f-0326d6c2ff4b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:44:12.162594 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WARNING py.warnings [None req-47ce351b-9245-4ee6-841f-0326d6c2ff4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:44:12.162594 dv-cinder-861032-1-smb devstack@keystone.service[93091]: warnings.warn(msg) Oct 12 04:44:12.162594 dv-cinder-861032-1-smb devstack@keystone.service[93091]: Oct 12 04:44:12.163758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce351b-9245-4ee6-841f-0326d6c2ff4b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:44:12.182267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 574/1155] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Oct 12 04:44:11 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:44:14.337837 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d66376-5148-4912-860b-6d6eea767430 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:14.338412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d66376-5148-4912-860b-6d6eea767430 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:14.338412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d66376-5148-4912-860b-6d6eea767430 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:14.339760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 582/1156] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:44:14.345756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef64e8-bd56-4414-b9c1-58c2427031c0 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:14.346170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef64e8-bd56-4414-b9c1-58c2427031c0 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:14.346319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef64e8-bd56-4414-b9c1-58c2427031c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:14.412108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e0ef64e8-bd56-4414-b9c1-58c2427031c0 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:44:14.413318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e0ef64e8-bd56-4414-b9c1-58c2427031c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:14.508982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 575/1157] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:44:14.801527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d66376-5148-4912-860b-6d6eea767430 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:44:14.803107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d2d66376-5148-4912-860b-6d6eea767430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:14.813094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:14.946944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d66376-5148-4912-860b-6d6eea767430 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:44:15.024492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:15.055480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f147ff-aa25-4116-80f1-4231d572ea37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:44:15.056077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f147ff-aa25-4116-80f1-4231d572ea37 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:15.056352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f147ff-aa25-4116-80f1-4231d572ea37 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:15.056625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f147ff-aa25-4116-80f1-4231d572ea37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:15.058190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-85f147ff-aa25-4116-80f1-4231d572ea37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:15.145934 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f147ff-aa25-4116-80f1-4231d572ea37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:44:15.147536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f147ff-aa25-4116-80f1-4231d572ea37 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:44:15.165518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 583/1158] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:44:17.466130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3952-e805-4aaa-a0f0-0b1259a35827 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:17.467203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3952-e805-4aaa-a0f0-0b1259a35827 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:17.467203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce3952-e805-4aaa-a0f0-0b1259a35827 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:17.468554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 576/1159] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:44:17.473831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a507c5-9d26-4027-a1a7-178d32e2e860 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:17.474240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a507c5-9d26-4027-a1a7-178d32e2e860 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:17.474356 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a507c5-9d26-4027-a1a7-178d32e2e860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:17.539031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a1a507c5-9d26-4027-a1a7-178d32e2e860 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:44:17.540245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a1a507c5-9d26-4027-a1a7-178d32e2e860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:17.587954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:17.637627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 584/1160] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:44:17.923991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce3952-e805-4aaa-a0f0-0b1259a35827 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:44:17.925564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-66ce3952-e805-4aaa-a0f0-0b1259a35827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:17.949666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:18.029736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce3952-e805-4aaa-a0f0-0b1259a35827 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:44:18.101972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631f89a-054c-40b1-99a8-904d4bf2e494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:44:18.102577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631f89a-054c-40b1-99a8-904d4bf2e494 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:18.102858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631f89a-054c-40b1-99a8-904d4bf2e494 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:18.103133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631f89a-054c-40b1-99a8-904d4bf2e494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:18.104756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-7631f89a-054c-40b1-99a8-904d4bf2e494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:18.177806 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:18.213197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631f89a-054c-40b1-99a8-904d4bf2e494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:44:18.214621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631f89a-054c-40b1-99a8-904d4bf2e494 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:44:18.232203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 577/1161] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:44:20.416834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61bd6-7c55-42d5-8a76-f8981e733c78 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:20.417387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61bd6-7c55-42d5-8a76-f8981e733c78 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:20.417387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61bd6-7c55-42d5-8a76-f8981e733c78 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:20.418771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 585/1162] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:44:20.424770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe05de-c815-40a3-8acd-42d1a73fe2d4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:20.425200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe05de-c815-40a3-8acd-42d1a73fe2d4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:20.425312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe05de-c815-40a3-8acd-42d1a73fe2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:20.490896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-4cbe05de-c815-40a3-8acd-42d1a73fe2d4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:44:20.492108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4cbe05de-c815-40a3-8acd-42d1a73fe2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:20.592493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 578/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:44:20.877101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed61bd6-7c55-42d5-8a76-f8981e733c78 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:44:20.878633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0ed61bd6-7c55-42d5-8a76-f8981e733c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:20.979584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed61bd6-7c55-42d5-8a76-f8981e733c78 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:44:21.048938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:21.050542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87395b-d931-406c-b89e-9c696af80381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:44:21.051272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87395b-d931-406c-b89e-9c696af80381 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:21.051779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87395b-d931-406c-b89e-9c696af80381 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:21.052260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87395b-d931-406c-b89e-9c696af80381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:21.054071 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5a87395b-d931-406c-b89e-9c696af80381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:21.161900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87395b-d931-406c-b89e-9c696af80381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:44:21.163229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87395b-d931-406c-b89e-9c696af80381 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:44:21.181355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 586/1164] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:44:23.445830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06773-3414-4cd3-847b-67b80a57db16 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:23.446377 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06773-3414-4cd3-847b-67b80a57db16 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:23.446377 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06773-3414-4cd3-847b-67b80a57db16 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:23.447732 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 579/1165] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:44:23.453475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241496db-7f23-49de-9670-dd3313cb4f8c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:23.453919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241496db-7f23-49de-9670-dd3313cb4f8c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:23.454058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241496db-7f23-49de-9670-dd3313cb4f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:23.519195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-241496db-7f23-49de-9670-dd3313cb4f8c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:44:23.520423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-241496db-7f23-49de-9670-dd3313cb4f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:23.572267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:23.619596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 587/1166] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:44:23.915502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06773-3414-4cd3-847b-67b80a57db16 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:44:23.917041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-abe06773-3414-4cd3-847b-67b80a57db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:23.953356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:24.020332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06773-3414-4cd3-847b-67b80a57db16 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:44:24.092418 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f795ab-6a64-4bb7-afc5-abfc7171740d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:44:24.093017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f795ab-6a64-4bb7-afc5-abfc7171740d service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:24.093290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f795ab-6a64-4bb7-afc5-abfc7171740d service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:24.093556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f795ab-6a64-4bb7-afc5-abfc7171740d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:24.095117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-86f795ab-6a64-4bb7-afc5-abfc7171740d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:24.172539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:24.202149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f795ab-6a64-4bb7-afc5-abfc7171740d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:44:24.203609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f795ab-6a64-4bb7-afc5-abfc7171740d service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:44:24.221380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 580/1167] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:44:26.547902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8bda-5d45-4e3f-acb6-292d3cc39b1a None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:26.548410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8bda-5d45-4e3f-acb6-292d3cc39b1a None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:26.548410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8bda-5d45-4e3f-acb6-292d3cc39b1a None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:26.549710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 588/1168] 10.222.0.18 () {54 vars in 927 bytes} [Wed Oct 12 04:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:44:26.554938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd1a88-d821-4360-85c9-b6148d2cad75 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:26.555380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd1a88-d821-4360-85c9-b6148d2cad75 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:26.555548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd1a88-d821-4360-85c9-b6148d2cad75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:26.621807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-52dd1a88-d821-4360-85c9-b6148d2cad75 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:44:26.623653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-52dd1a88-d821-4360-85c9-b6148d2cad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:26.720644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 581/1169] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Oct 12 04:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:44:27.006992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf8bda-5d45-4e3f-acb6-292d3cc39b1a None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:44:27.008607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fabf8bda-5d45-4e3f-acb6-292d3cc39b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:27.109640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf8bda-5d45-4e3f-acb6-292d3cc39b1a None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:44:27.180373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c66b6-6cdf-4c93-9c99-09555fdcc085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:44:27.180968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c66b6-6cdf-4c93-9c99-09555fdcc085 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:44:27.181245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c66b6-6cdf-4c93-9c99-09555fdcc085 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:44:27.181517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c66b6-6cdf-4c93-9c99-09555fdcc085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:44:27.183065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-940c66b6-6cdf-4c93-9c99-09555fdcc085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:44:27.192690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:27.293784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c66b6-6cdf-4c93-9c99-09555fdcc085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:44:27.295694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c66b6-6cdf-4c93-9c99-09555fdcc085 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:44:27.313904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 589/1170] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:44:36.718915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=82 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:44:37.311683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=50 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:45.404397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d5ebd-f8e7-4345-b815-ce630b07c847 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:45.405046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d5ebd-f8e7-4345-b815-ce630b07c847 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:45.405046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d5ebd-f8e7-4345-b815-ce630b07c847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:45.480241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b88d5ebd-f8e7-4345-b815-ce630b07c847 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:45:45.481954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b88d5ebd-f8e7-4345-b815-ce630b07c847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:45.577636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 582/1171] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:45:45.585747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89ce2-a1e0-4a39-b3ac-14b561cb77ea None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:45.586207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89ce2-a1e0-4a39-b3ac-14b561cb77ea None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:45.586310 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89ce2-a1e0-4a39-b3ac-14b561cb77ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:45.660670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d6a89ce2-a1e0-4a39-b3ac-14b561cb77ea None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:45:45.661787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d6a89ce2-a1e0-4a39-b3ac-14b561cb77ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:45.755912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 590/1172] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:45:45.760501 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d5ebd-f8e7-4345-b815-ce630b07c847 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:45:45.761694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b88d5ebd-f8e7-4345-b815-ce630b07c847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:45.772965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d5ebd-f8e7-4345-b815-ce630b07c847 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:45:45.832411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:45.865860 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:45:45.866454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:45.866732 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:45.867003 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:45.867664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:45:45.867982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:45:45.868955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WARNING py.warnings [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:45:45.868955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: warnings.warn(msg) Oct 12 04:45:45.868955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: Oct 12 04:45:45.869824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:45:45.881358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 583/1173] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:45:45.891317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a89ce2-a1e0-4a39-b3ac-14b561cb77ea None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:45:45.900308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a89ce2-a1e0-4a39-b3ac-14b561cb77ea None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:45:45.961403 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:45.993990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c01c30-4507-41b8-9e9b-0691de810f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:45:45.994590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c01c30-4507-41b8-9e9b-0691de810f15 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:45.994869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c01c30-4507-41b8-9e9b-0691de810f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:45.995140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c01c30-4507-41b8-9e9b-0691de810f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:45.995794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c01c30-4507-41b8-9e9b-0691de810f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:45:45.997422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WARNING py.warnings [None req-99c01c30-4507-41b8-9e9b-0691de810f15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:45:45.997422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: warnings.warn(msg) Oct 12 04:45:45.997422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: Oct 12 04:45:45.998618 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c01c30-4507-41b8-9e9b-0691de810f15 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:45:46.053106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 591/1174] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:45:45 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:45:46.057159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:45:46.058664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:46.092677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbb428-394e-4275-9784-80e7eaafa4a4 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:45:46.185481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ef798-3838-4f6c-8899-2240cf43a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:45:46.186080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef798-3838-4f6c-8899-2240cf43a1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:46.186386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef798-3838-4f6c-8899-2240cf43a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:46.186657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef798-3838-4f6c-8899-2240cf43a1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:46.187300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ef798-3838-4f6c-8899-2240cf43a1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:45:46.188310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WARNING py.warnings [None req-8e1ef798-3838-4f6c-8899-2240cf43a1c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:45:46.188310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: warnings.warn(msg) Oct 12 04:45:46.188310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: Oct 12 04:45:46.189559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ef798-3838-4f6c-8899-2240cf43a1c9 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:45:46.231935 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 584/1175] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:45:46 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:45:46.235950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c01c30-4507-41b8-9e9b-0691de810f15 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:45:46.237497 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-99c01c30-4507-41b8-9e9b-0691de810f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:46.300237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c01c30-4507-41b8-9e9b-0691de810f15 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:45:46.383306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:46.394560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52137d-33e7-4001-812f-9d9fe47c922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:45:46.395166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52137d-33e7-4001-812f-9d9fe47c922d admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:46.395476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52137d-33e7-4001-812f-9d9fe47c922d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:46.395752 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52137d-33e7-4001-812f-9d9fe47c922d admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:46.396389 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52137d-33e7-4001-812f-9d9fe47c922d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:45:46.397976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52137d-33e7-4001-812f-9d9fe47c922d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:45:46.410303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 592/1176] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:45:46.414297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ef798-3838-4f6c-8899-2240cf43a1c9 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:45:46.415823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8e1ef798-3838-4f6c-8899-2240cf43a1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:46.426981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ef798-3838-4f6c-8899-2240cf43a1c9 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:45:46.452602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:46.521948 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987bbbe-02ad-4de0-83cf-b4ccb3b6f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:45:46.522481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987bbbe-02ad-4de0-83cf-b4ccb3b6f339 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:46.522759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987bbbe-02ad-4de0-83cf-b4ccb3b6f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:46.523065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987bbbe-02ad-4de0-83cf-b4ccb3b6f339 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:46.523731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987bbbe-02ad-4de0-83cf-b4ccb3b6f339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:45:46.525311 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987bbbe-02ad-4de0-83cf-b4ccb3b6f339 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:45:46.537191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 585/1177] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:45:46.541301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52137d-33e7-4001-812f-9d9fe47c922d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:45:46.542826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9e52137d-33e7-4001-812f-9d9fe47c922d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:46.576331 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52137d-33e7-4001-812f-9d9fe47c922d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:45:46.668039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5204b89-ebe2-4ccc-be0d-c29c12fb1ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:45:46.668686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204b89-ebe2-4ccc-be0d-c29c12fb1ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:46.668970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204b89-ebe2-4ccc-be0d-c29c12fb1ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:46.669243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204b89-ebe2-4ccc-be0d-c29c12fb1ed0 admin admin] PATH_INFO: `/v3/projects/b446d4537a2f4cb5a9d7c879d09d2e61/users/3e215ddf1c3d4e4599fd30bbec95d427/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:46.693794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5204b89-ebe2-4ccc-be0d-c29c12fb1ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b446d4537a2f4cb5a9d7c879d09d2e61, user_id=3e215ddf1c3d4e4599fd30bbec95d427, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:45:46.696570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5204b89-ebe2-4ccc-be0d-c29c12fb1ed0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:45:46.721356 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 593/1178] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:45:46 2022] PUT /identity/v3/projects/b446d4537a2f4cb5a9d7c879d09d2e61/users/3e215ddf1c3d4e4599fd30bbec95d427/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:45:46.732463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5cea0-8f2a-4016-b9fa-2107bbf8492d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:46.732760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5cea0-8f2a-4016-b9fa-2107bbf8492d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:46.733042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5cea0-8f2a-4016-b9fa-2107bbf8492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:46.789320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-65b5cea0-8f2a-4016-b9fa-2107bbf8492d None None] MFA Rules not processed for user `3e215ddf1c3d4e4599fd30bbec95d427`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:45:46.790483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-65b5cea0-8f2a-4016-b9fa-2107bbf8492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:46.867964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 586/1179] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:45:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:45:46.881125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeb115-b9d8-46d2-afd9-d20b803c8e87 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:46.881413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeb115-b9d8-46d2-afd9-d20b803c8e87 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:46.881688 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeb115-b9d8-46d2-afd9-d20b803c8e87 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:46.883036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 594/1180] 10.222.0.18 () {54 vars in 963 bytes} [Wed Oct 12 04:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:45:46.888643 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eeef2-3a1c-41ce-b9b5-fada8174b7cb None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:46.888966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eeef2-3a1c-41ce-b9b5-fada8174b7cb None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:46.889245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eeef2-3a1c-41ce-b9b5-fada8174b7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:46.920899 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:46.964766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-226eeef2-3a1c-41ce-b9b5-fada8174b7cb None None] MFA Rules not processed for user `946db23ba1fe47999ae12f8380f4c48a`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:45:46.966548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-226eeef2-3a1c-41ce-b9b5-fada8174b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:47.041944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 587/1181] 10.222.0.18 () {58 vars in 1060 bytes} [Wed Oct 12 04:45:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:45:47.049769 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeb115-b9d8-46d2-afd9-d20b803c8e87 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:45:47.051326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-45aeb115-b9d8-46d2-afd9-d20b803c8e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:47.102036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:47.155217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeb115-b9d8-46d2-afd9-d20b803c8e87 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:45:47.226885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0bc4a-26d5-47b5-9b99-f5b1ddf73490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:45:47.227511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0bc4a-26d5-47b5-9b99-f5b1ddf73490 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:47.227796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0bc4a-26d5-47b5-9b99-f5b1ddf73490 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:47.228073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0bc4a-26d5-47b5-9b99-f5b1ddf73490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:47.229649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e1c0bc4a-26d5-47b5-9b99-f5b1ddf73490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:47.326210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0bc4a-26d5-47b5-9b99-f5b1ddf73490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:45:47.327582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0bc4a-26d5-47b5-9b99-f5b1ddf73490 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:45:47.331004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:47.346091 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 595/1182] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:45:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:45:47.390990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf76c-1322-4724-b09e-24fdc8f45b58 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:47.391326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf76c-1322-4724-b09e-24fdc8f45b58 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:47.391613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf76c-1322-4724-b09e-24fdc8f45b58 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:47.392872 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 588/1183] 10.222.0.18 () {52 vars in 830 bytes} [Wed Oct 12 04:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:45:47.396506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0bc4a-26d5-47b5-9b99-f5b1ddf73490 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:45:47.397711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e1c0bc4a-26d5-47b5-9b99-f5b1ddf73490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:47.495619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0bc4a-26d5-47b5-9b99-f5b1ddf73490 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:45:47.586990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:45:47.587669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:47.587943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:47.588210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] PATH_INFO: `/v3/users/3e215ddf1c3d4e4599fd30bbec95d427` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:47.601769 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e215ddf1c3d4e4599fd30bbec95d427)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:45:47.602785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WARNING py.warnings [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:45:47.602785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: warnings.warn(msg) Oct 12 04:45:47.602785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: Oct 12 04:45:47.604044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:45:47.613557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:47.668665 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e215ddf1c3d4e4599fd30bbec95d427'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:45:47.682643 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e215ddf1c3d4e4599fd30bbec95d427'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:45:47.683203 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e215ddf1c3d4e4599fd30bbec95d427'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:45:47.683662 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e215ddf1c3d4e4599fd30bbec95d427'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:45:47.692770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e215ddf1c3d4e4599fd30bbec95d427'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:45:47.721226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 596/1184] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:45:47 2022] DELETE /identity/v3/users/3e215ddf1c3d4e4599fd30bbec95d427 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:45:47.725674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da234574-d07e-4656-ae3c-d7839d4149ed None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:47.726130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da234574-d07e-4656-ae3c-d7839d4149ed None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:47.726233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da234574-d07e-4656-ae3c-d7839d4149ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:47.782278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-da234574-d07e-4656-ae3c-d7839d4149ed None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:45:47.783502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-da234574-d07e-4656-ae3c-d7839d4149ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:47.858537 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:47.870984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 589/1185] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:45:47.881405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:45:47.882609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:47.980530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8357b-8300-4b85-9802-52e67df71cb8 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:45:48.034023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:48.054958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca4877-6109-443d-a308-20405fd34da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:45:48.055610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca4877-6109-443d-a308-20405fd34da4 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:48.055888 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca4877-6109-443d-a308-20405fd34da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:48.056158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca4877-6109-443d-a308-20405fd34da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:48.057726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-16ca4877-6109-443d-a308-20405fd34da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:48.164256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca4877-6109-443d-a308-20405fd34da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:45:48.165607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca4877-6109-443d-a308-20405fd34da4 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:45:48.184148 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 597/1186] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:45:48.531388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da234574-d07e-4656-ae3c-d7839d4149ed None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:45:48.532630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-da234574-d07e-4656-ae3c-d7839d4149ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:45:48.543747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da234574-d07e-4656-ae3c-d7839d4149ed None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:45:48.646584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:45:48.647208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:45:48.647518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:45:48.647788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] PATH_INFO: `/v3/projects/b446d4537a2f4cb5a9d7c879d09d2e61` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:45:48.657294 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b446d4537a2f4cb5a9d7c879d09d2e61)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:45:48.658309 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WARNING py.warnings [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:45:48.658309 dv-cinder-861032-1-smb devstack@keystone.service[93091]: warnings.warn(msg) Oct 12 04:45:48.658309 dv-cinder-861032-1-smb devstack@keystone.service[93091]: Oct 12 04:45:48.659534 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:45:48.717921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b446d4537a2f4cb5a9d7c879d09d2e61', 'request_id': 'req-dc8d880e-40cc-43d1-ae64-153fa10529ae'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:45:48.730885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b446d4537a2f4cb5a9d7c879d09d2e61', 'request_id': 'req-dc8d880e-40cc-43d1-ae64-153fa10529ae'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:45:48.740359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b446d4537a2f4cb5a9d7c879d09d2e61', 'request_id': 'req-dc8d880e-40cc-43d1-ae64-153fa10529ae'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:45:48.763685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] The token cache is being invalidate because project b446d4537a2f4cb5a9d7c879d09d2e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:45:48.764004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:45:48.764457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-dc8d880e-40cc-43d1-ae64-153fa10529ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:45:48.765873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 590/1187] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:45:48 2022] DELETE /identity/v3/projects/b446d4537a2f4cb5a9d7c879d09d2e61 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:45:58.181836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=62 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:45:58.761030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:47:19.807648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec80ed-4ccf-4236-9d6c-4b5cbf02b340 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:19.808243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec80ed-4ccf-4236-9d6c-4b5cbf02b340 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:19.808243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec80ed-4ccf-4236-9d6c-4b5cbf02b340 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:19.809595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 598/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:47:19.814466 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06a0b4-e089-433b-9180-0f66f6a5b8cd None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:19.814863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06a0b4-e089-433b-9180-0f66f6a5b8cd None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:19.815021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06a0b4-e089-433b-9180-0f66f6a5b8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:19.894487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ce06a0b4-e089-433b-9180-0f66f6a5b8cd None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:47:19.895650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ce06a0b4-e089-433b-9180-0f66f6a5b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:19.996801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 591/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:47:20.150283 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec80ed-4ccf-4236-9d6c-4b5cbf02b340 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:47:20.152445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e8ec80ed-4ccf-4236-9d6c-4b5cbf02b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:20.270517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec80ed-4ccf-4236-9d6c-4b5cbf02b340 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:47:20.276129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712f983-b014-461b-94e3-a9fc1fd44ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:47:20.276772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712f983-b014-461b-94e3-a9fc1fd44ed0 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:20.277058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712f983-b014-461b-94e3-a9fc1fd44ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:20.277362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712f983-b014-461b-94e3-a9fc1fd44ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:20.285822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712f983-b014-461b-94e3-a9fc1fd44ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:47:20.287431 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712f983-b014-461b-94e3-a9fc1fd44ed0 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:47:20.296551 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 599/1190] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:47:21.368719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15822d-0200-4e79-8a47-4642e992b76b None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:21.369262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15822d-0200-4e79-8a47-4642e992b76b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:21.369262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15822d-0200-4e79-8a47-4642e992b76b None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:21.370509 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 592/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:47:21.376632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870e2df-cdc5-419d-8ec0-bec611c24ba3 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:21.377085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870e2df-cdc5-419d-8ec0-bec611c24ba3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:21.377218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870e2df-cdc5-419d-8ec0-bec611c24ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:21.396145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2870e2df-cdc5-419d-8ec0-bec611c24ba3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:47:21.397355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2870e2df-cdc5-419d-8ec0-bec611c24ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:21.405621 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 600/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:47:21.493473 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4894f9-b666-4649-a16f-abb237992546 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:21.493760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4894f9-b666-4649-a16f-abb237992546 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:21.494041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4894f9-b666-4649-a16f-abb237992546 None None] PATH_INFO: `/v3` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:21.495322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 593/1193] 10.222.0.27 () {54 vars in 925 bytes} [Wed Oct 12 04:47:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:47:21.501337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359e8b-59da-4803-aa6d-b23b5af55e06 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:21.501623 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359e8b-59da-4803-aa6d-b23b5af55e06 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:21.501900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359e8b-59da-4803-aa6d-b23b5af55e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:21.560914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2f359e8b-59da-4803-aa6d-b23b5af55e06 None None] MFA Rules not processed for user `332a44161d204223983ed2aa3aef9317`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:47:21.562616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2f359e8b-59da-4803-aa6d-b23b5af55e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:21.578423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4894f9-b666-4649-a16f-abb237992546 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:47:21.593355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4894f9-b666-4649-a16f-abb237992546 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:47:21.599425 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfe333-37de-4128-9d47-9ac245a5e19c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:47:21.600026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfe333-37de-4128-9d47-9ac245a5e19c service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:21.600305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfe333-37de-4128-9d47-9ac245a5e19c service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:21.600580 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfe333-37de-4128-9d47-9ac245a5e19c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:21.609023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfe333-37de-4128-9d47-9ac245a5e19c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:47:21.610599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfe333-37de-4128-9d47-9ac245a5e19c service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:47:21.619805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 594/1194] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:47:21.620218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:47:21.640307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 601/1195] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Oct 12 04:47:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:47:30.285354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ffda9-8e5b-4b3a-89e4-3b26b432e618 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:30.285784 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ffda9-8e5b-4b3a-89e4-3b26b432e618 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:30.285914 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ffda9-8e5b-4b3a-89e4-3b26b432e618 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:30.287243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 595/1196] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 04:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:47:30.292106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d667a2-243c-4d9e-b5c8-657890a921e3 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:30.292508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d667a2-243c-4d9e-b5c8-657890a921e3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:30.292664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d667a2-243c-4d9e-b5c8-657890a921e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:30.311967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-25d667a2-243c-4d9e-b5c8-657890a921e3 None None] MFA Rules not processed for user `332a44161d204223983ed2aa3aef9317`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:47:30.313145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-25d667a2-243c-4d9e-b5c8-657890a921e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:30.321592 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 602/1197] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 04:47:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:47:30.329567 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ffda9-8e5b-4b3a-89e4-3b26b432e618 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:47:30.342884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ffda9-8e5b-4b3a-89e4-3b26b432e618 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:47:30.347794 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283cfb0-8b1e-4ba8-ab0b-477213e787df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:47:30.348419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283cfb0-8b1e-4ba8-ab0b-477213e787df service placement] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:30.348702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283cfb0-8b1e-4ba8-ab0b-477213e787df service placement] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:30.348979 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283cfb0-8b1e-4ba8-ab0b-477213e787df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:30.356962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283cfb0-8b1e-4ba8-ab0b-477213e787df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:47:30.358518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283cfb0-8b1e-4ba8-ab0b-477213e787df service placement] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:47:30.367813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 596/1198] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:47:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:47:33.078552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13ee5-9d7c-4e5a-9026-45e24509ed42 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:33.079160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13ee5-9d7c-4e5a-9026-45e24509ed42 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:33.079160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13ee5-9d7c-4e5a-9026-45e24509ed42 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:33.080496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 603/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:47:33.086906 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec2f2-fdb1-40c5-96ca-cf73796aaf2f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:33.087388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec2f2-fdb1-40c5-96ca-cf73796aaf2f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:33.087493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec2f2-fdb1-40c5-96ca-cf73796aaf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:33.107435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-3d9ec2f2-fdb1-40c5-96ca-cf73796aaf2f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:47:33.108654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-3d9ec2f2-fdb1-40c5-96ca-cf73796aaf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:33.127017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 597/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:47:33.291778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db13ee5-9d7c-4e5a-9026-45e24509ed42 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:47:33.307380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db13ee5-9d7c-4e5a-9026-45e24509ed42 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:47:33.313328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fe5f7-2eef-4cc4-9551-5193357ff034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:47:33.313922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe5f7-2eef-4cc4-9551-5193357ff034 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:33.314204 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe5f7-2eef-4cc4-9551-5193357ff034 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:33.314481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe5f7-2eef-4cc4-9551-5193357ff034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:33.322327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fe5f7-2eef-4cc4-9551-5193357ff034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:47:33.323948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fe5f7-2eef-4cc4-9551-5193357ff034 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:47:33.334036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 604/1201] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:47:34.393154 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d1e38-bb47-435b-bf12-7d8f2c3c4e35 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:34.393607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d1e38-bb47-435b-bf12-7d8f2c3c4e35 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:34.393745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d1e38-bb47-435b-bf12-7d8f2c3c4e35 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:34.395084 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 598/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 04:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:47:34.401226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea56ad5-8079-40eb-b095-6ed001d22b9d None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:34.401668 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea56ad5-8079-40eb-b095-6ed001d22b9d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:34.401807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea56ad5-8079-40eb-b095-6ed001d22b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:34.421321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bea56ad5-8079-40eb-b095-6ed001d22b9d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:47:34.422513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bea56ad5-8079-40eb-b095-6ed001d22b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:34.430252 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 605/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 04:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:47:34.579687 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d1e38-bb47-435b-bf12-7d8f2c3c4e35 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:47:34.594730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d1e38-bb47-435b-bf12-7d8f2c3c4e35 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:47:34.600130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d1d1c-7aed-4feb-a3bb-54a50ae7f330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:47:34.600715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d1d1c-7aed-4feb-a3bb-54a50ae7f330 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:34.600995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d1d1c-7aed-4feb-a3bb-54a50ae7f330 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:34.601268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d1d1c-7aed-4feb-a3bb-54a50ae7f330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:34.609070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d1d1c-7aed-4feb-a3bb-54a50ae7f330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:47:34.610640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d1d1c-7aed-4feb-a3bb-54a50ae7f330 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:47:34.619697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 599/1204] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:47:38.571777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d776d-f881-489e-9f6a-a2574168dcfc None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:38.572712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d776d-f881-489e-9f6a-a2574168dcfc None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:38.573033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d776d-f881-489e-9f6a-a2574168dcfc None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:38.574470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 606/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:47:38.580118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cf12d-85f4-444d-a7cb-1509c1c8eb98 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:38.580510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cf12d-85f4-444d-a7cb-1509c1c8eb98 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:38.580682 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cf12d-85f4-444d-a7cb-1509c1c8eb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:38.600625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5a7cf12d-85f4-444d-a7cb-1509c1c8eb98 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:47:38.601820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5a7cf12d-85f4-444d-a7cb-1509c1c8eb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:38.610217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 600/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:47:38.896745 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d776d-f881-489e-9f6a-a2574168dcfc None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:47:38.898514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-926d776d-f881-489e-9f6a-a2574168dcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:38.975308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d776d-f881-489e-9f6a-a2574168dcfc None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:47:38.978806 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc4ffb-77ab-4205-8a1d-6aca097115ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:47:38.979449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4ffb-77ab-4205-8a1d-6aca097115ef service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:38.979728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4ffb-77ab-4205-8a1d-6aca097115ef service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:38.980002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc4ffb-77ab-4205-8a1d-6aca097115ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:38.988670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc4ffb-77ab-4205-8a1d-6aca097115ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:47:38.990084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc4ffb-77ab-4205-8a1d-6aca097115ef service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:47:38.999150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 607/1207] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:47:41.121951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1abb1-9013-481c-8d97-41ace223d331 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:41.122494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1abb1-9013-481c-8d97-41ace223d331 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:41.122494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1abb1-9013-481c-8d97-41ace223d331 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:41.124470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 601/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:47:41.129746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12db35-c7dc-4dd2-81fc-a9276bbf3eef None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:41.130144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12db35-c7dc-4dd2-81fc-a9276bbf3eef None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:41.130300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12db35-c7dc-4dd2-81fc-a9276bbf3eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:41.149215 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-cd12db35-c7dc-4dd2-81fc-a9276bbf3eef None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:47:41.150396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cd12db35-c7dc-4dd2-81fc-a9276bbf3eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:41.158102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 608/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:47:41.448215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1abb1-9013-481c-8d97-41ace223d331 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:47:41.449933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dfd1abb1-9013-481c-8d97-41ace223d331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:41.463815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1abb1-9013-481c-8d97-41ace223d331 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:47:41.467454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab01d9-09f7-43d6-bea8-d758cbb6a59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:47:41.468092 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab01d9-09f7-43d6-bea8-d758cbb6a59b service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:41.468377 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab01d9-09f7-43d6-bea8-d758cbb6a59b service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:41.468654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab01d9-09f7-43d6-bea8-d758cbb6a59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:41.478261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab01d9-09f7-43d6-bea8-d758cbb6a59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:47:41.479726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab01d9-09f7-43d6-bea8-d758cbb6a59b service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:47:41.489051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 602/1210] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:47:45.044764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203197b5-5ffe-4f95-827a-90794f08a002 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:45.045310 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203197b5-5ffe-4f95-827a-90794f08a002 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:45.045406 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203197b5-5ffe-4f95-827a-90794f08a002 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:45.046736 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 609/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:47:45.051894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2e93-dc74-45f1-a400-949ba06e965e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:45.052341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2e93-dc74-45f1-a400-949ba06e965e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:45.052463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2e93-dc74-45f1-a400-949ba06e965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:45.060036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:47:45.073175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c20f2e93-dc74-45f1-a400-949ba06e965e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:47:45.074379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c20f2e93-dc74-45f1-a400-949ba06e965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:45.082657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 603/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:47:45.382438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203197b5-5ffe-4f95-827a-90794f08a002 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:47:45.384146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-203197b5-5ffe-4f95-827a-90794f08a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:45.461303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203197b5-5ffe-4f95-827a-90794f08a002 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:47:45.464864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870e487-0725-439a-bbec-a30a4c775923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:47:45.465447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870e487-0725-439a-bbec-a30a4c775923 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:45.465724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870e487-0725-439a-bbec-a30a4c775923 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:45.465994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870e487-0725-439a-bbec-a30a4c775923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:45.474570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870e487-0725-439a-bbec-a30a4c775923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:47:45.476013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870e487-0725-439a-bbec-a30a4c775923 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:47:45.485027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 610/1213] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:47:47.604712 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370015-3d9b-40e1-9920-fa07d6efc865 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:47.605177 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370015-3d9b-40e1-9920-fa07d6efc865 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:47.605298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370015-3d9b-40e1-9920-fa07d6efc865 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:47.606644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 604/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 04:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:47:47.612012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28302c05-1523-4d74-a6b0-f1f8374cd5b6 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:47.612410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28302c05-1523-4d74-a6b0-f1f8374cd5b6 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:47.612595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28302c05-1523-4d74-a6b0-f1f8374cd5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:47.632253 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-28302c05-1523-4d74-a6b0-f1f8374cd5b6 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:47:47.633444 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-28302c05-1523-4d74-a6b0-f1f8374cd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:47.641836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 611/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 04:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:47:47.941167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370015-3d9b-40e1-9920-fa07d6efc865 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:47:47.942901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4c370015-3d9b-40e1-9920-fa07d6efc865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:47:47.955538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370015-3d9b-40e1-9920-fa07d6efc865 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:47:47.959343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801aeeeb-4102-4b8f-887c-1a1e26451761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:47:47.959942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aeeeb-4102-4b8f-887c-1a1e26451761 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:47:47.960224 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aeeeb-4102-4b8f-887c-1a1e26451761 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:47:47.960502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aeeeb-4102-4b8f-887c-1a1e26451761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:47:47.969265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801aeeeb-4102-4b8f-887c-1a1e26451761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:47:47.970672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801aeeeb-4102-4b8f-887c-1a1e26451761 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:47:47.979813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 605/1216] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:47:57.627029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:47:57.975731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=8 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:13.683236 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9c5f-50a2-4fc3-83be-9c276d5c4c48 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:13.683904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9c5f-50a2-4fc3-83be-9c276d5c4c48 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:13.683904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9c5f-50a2-4fc3-83be-9c276d5c4c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:13.712936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8aad9c5f-50a2-4fc3-83be-9c276d5c4c48 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:13.714733 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8aad9c5f-50a2-4fc3-83be-9c276d5c4c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:13.729900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 612/1217] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:13.739944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc3a1-25d5-4d7e-8bfe-24e29eb426ec None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:13.740505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc3a1-25d5-4d7e-8bfe-24e29eb426ec None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:13.740505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddc3a1-25d5-4d7e-8bfe-24e29eb426ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:13.767962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-1cddc3a1-25d5-4d7e-8bfe-24e29eb426ec None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:13.769804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1cddc3a1-25d5-4d7e-8bfe-24e29eb426ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:13.782252 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 606/1218] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:13.787905 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad9c5f-50a2-4fc3-83be-9c276d5c4c48 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:13.801113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad9c5f-50a2-4fc3-83be-9c276d5c4c48 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:13.812666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd2827-2b84-4605-b23e-3db220077d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:13.813315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd2827-2b84-4605-b23e-3db220077d0a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:13.813596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd2827-2b84-4605-b23e-3db220077d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:13.813872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd2827-2b84-4605-b23e-3db220077d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:13.814546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd2827-2b84-4605-b23e-3db220077d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:13.814856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd2827-2b84-4605-b23e-3db220077d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:13.815943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WARNING py.warnings [None req-a6cd2827-2b84-4605-b23e-3db220077d0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:49:13.815943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: warnings.warn(msg) Oct 12 04:49:13.815943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: Oct 12 04:49:13.816857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd2827-2b84-4605-b23e-3db220077d0a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:13.837029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 613/1219] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:13.846325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc3a1-25d5-4d7e-8bfe-24e29eb426ec None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:13.862315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddc3a1-25d5-4d7e-8bfe-24e29eb426ec None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:13.872270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1503957-9eca-49e9-8a40-558d9340bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:13.873652 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1503957-9eca-49e9-8a40-558d9340bd15 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:13.874160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1503957-9eca-49e9-8a40-558d9340bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:13.874667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1503957-9eca-49e9-8a40-558d9340bd15 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:13.875566 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1503957-9eca-49e9-8a40-558d9340bd15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:13.876853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WARNING py.warnings [None req-d1503957-9eca-49e9-8a40-558d9340bd15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:49:13.876853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: warnings.warn(msg) Oct 12 04:49:13.876853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: Oct 12 04:49:13.879162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1503957-9eca-49e9-8a40-558d9340bd15 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:13.893948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b035e-b1a2-4902-9bb5-126769319662 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:13.894340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b035e-b1a2-4902-9bb5-126769319662 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:13.894526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b035e-b1a2-4902-9bb5-126769319662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:13.933023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-920b035e-b1a2-4902-9bb5-126769319662 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:13.935655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-920b035e-b1a2-4902-9bb5-126769319662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:13.942729 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 607/1220] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:13 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:13.946527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1503957-9eca-49e9-8a40-558d9340bd15 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:13.953257 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 614/1221] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:49:13.966496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee164ee8-2af6-44ad-8b94-126d21bf2a19 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:13.966496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee164ee8-2af6-44ad-8b94-126d21bf2a19 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:13.966797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee164ee8-2af6-44ad-8b94-126d21bf2a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.014303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-ee164ee8-2af6-44ad-8b94-126d21bf2a19 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.014303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ee164ee8-2af6-44ad-8b94-126d21bf2a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.048809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1503957-9eca-49e9-8a40-558d9340bd15 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.064506 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fb772-fba8-4645-ae2b-8c86dc3c0c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.065495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fb772-fba8-4645-ae2b-8c86dc3c0c19 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.066004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fb772-fba8-4645-ae2b-8c86dc3c0c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.066497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fb772-fba8-4645-ae2b-8c86dc3c0c19 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.067518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fb772-fba8-4645-ae2b-8c86dc3c0c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.069677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fb772-fba8-4645-ae2b-8c86dc3c0c19 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.110391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 608/1222] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:13 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:14.112118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f58ec-cc33-4a30-86b5-c917f74c84a6 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.112642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f58ec-cc33-4a30-86b5-c917f74c84a6 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.113256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f58ec-cc33-4a30-86b5-c917f74c84a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.128045 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 615/1223] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:49:14.130561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee164ee8-2af6-44ad-8b94-126d21bf2a19 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.141212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee164ee8-2af6-44ad-8b94-126d21bf2a19 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.145032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-358f58ec-cc33-4a30-86b5-c917f74c84a6 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.146496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-358f58ec-cc33-4a30-86b5-c917f74c84a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.152708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82967-08a1-4087-b533-047f456cd305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.153639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82967-08a1-4087-b533-047f456cd305 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.154499 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82967-08a1-4087-b533-047f456cd305 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.160007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82967-08a1-4087-b533-047f456cd305 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.160918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82967-08a1-4087-b533-047f456cd305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.163961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82967-08a1-4087-b533-047f456cd305 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.171198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 609/1224] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.179924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5eca9-d3e7-463b-bbe6-d527b1940911 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.180674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5eca9-d3e7-463b-bbe6-d527b1940911 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.181199 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5eca9-d3e7-463b-bbe6-d527b1940911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.189783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 616/1225] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:14.193116 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82967-08a1-4087-b533-047f456cd305 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.215393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82967-08a1-4087-b533-047f456cd305 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.222776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6ba5eca9-d3e7-463b-bbe6-d527b1940911 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.224005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6ba5eca9-d3e7-463b-bbe6-d527b1940911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.224829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538948-9720-4e94-a0fa-cfce577ce801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.225454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538948-9720-4e94-a0fa-cfce577ce801 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.225738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538948-9720-4e94-a0fa-cfce577ce801 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.226019 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538948-9720-4e94-a0fa-cfce577ce801 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.226870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8538948-9720-4e94-a0fa-cfce577ce801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:14.227181 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8538948-9720-4e94-a0fa-cfce577ce801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.228923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8538948-9720-4e94-a0fa-cfce577ce801 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.234265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 610/1226] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.237751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2401-fffa-4180-9653-49d580b2e865 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.238046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2401-fffa-4180-9653-49d580b2e865 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.238325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2401-fffa-4180-9653-49d580b2e865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.249708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 617/1227] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:14.251620 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538948-9720-4e94-a0fa-cfce577ce801 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.262418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538948-9720-4e94-a0fa-cfce577ce801 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.266459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-1b7a2401-fffa-4180-9653-49d580b2e865 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.267318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f21eb-a712-42ee-8c53-a1ee5f1364a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.267683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1b7a2401-fffa-4180-9653-49d580b2e865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.268043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f21eb-a712-42ee-8c53-a1ee5f1364a8 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.268326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f21eb-a712-42ee-8c53-a1ee5f1364a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.268701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f21eb-a712-42ee-8c53-a1ee5f1364a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.269419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f21eb-a712-42ee-8c53-a1ee5f1364a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.270927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f21eb-a712-42ee-8c53-a1ee5f1364a8 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.275872 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 611/1228] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.277141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cb8b1-7e99-4e63-aacb-adeaffe71034 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.277425 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cb8b1-7e99-4e63-aacb-adeaffe71034 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.277700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cb8b1-7e99-4e63-aacb-adeaffe71034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.282461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 618/1229] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:14.283660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11763767-9dcf-4c8b-962e-c8031f83aad5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.283948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11763767-9dcf-4c8b-962e-c8031f83aad5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.284347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11763767-9dcf-4c8b-962e-c8031f83aad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.297558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b39cb8b1-7e99-4e63-aacb-adeaffe71034 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.298755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b39cb8b1-7e99-4e63-aacb-adeaffe71034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.304476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-11763767-9dcf-4c8b-962e-c8031f83aad5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.305615 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-11763767-9dcf-4c8b-962e-c8031f83aad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.306536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 612/1230] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.308292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb983f-f47f-441e-b1ed-c85dd409e440 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.308577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb983f-f47f-441e-b1ed-c85dd409e440 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.308850 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb983f-f47f-441e-b1ed-c85dd409e440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.315379 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 619/1231] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.315535 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108a38-65bf-468b-9fbd-6075c8726766 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.315814 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108a38-65bf-468b-9fbd-6075c8726766 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.316157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86108a38-65bf-468b-9fbd-6075c8726766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.330653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b2bb983f-f47f-441e-b1ed-c85dd409e440 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.331887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b2bb983f-f47f-441e-b1ed-c85dd409e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.335565 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-86108a38-65bf-468b-9fbd-6075c8726766 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.336713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-86108a38-65bf-468b-9fbd-6075c8726766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.340500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 613/1232] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.341292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb983f-f47f-441e-b1ed-c85dd409e440 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.347939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 620/1233] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.349946 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e185b-9b3b-456d-85be-2b9a3b566d14 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.350232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e185b-9b3b-456d-85be-2b9a3b566d14 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.350503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e185b-9b3b-456d-85be-2b9a3b566d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.350876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb983f-f47f-441e-b1ed-c85dd409e440 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.356030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e812f1a-714d-4e7c-b090-65b091402449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.356632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e812f1a-714d-4e7c-b090-65b091402449 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.357046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e812f1a-714d-4e7c-b090-65b091402449 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.357270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e812f1a-714d-4e7c-b090-65b091402449 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.357898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e812f1a-714d-4e7c-b090-65b091402449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.360633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e812f1a-714d-4e7c-b090-65b091402449 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.370699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-355e185b-9b3b-456d-85be-2b9a3b566d14 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.371913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-355e185b-9b3b-456d-85be-2b9a3b566d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.380836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 621/1234] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.381565 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e185b-9b3b-456d-85be-2b9a3b566d14 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.393135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 614/1235] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:14.393135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e812f1a-714d-4e7c-b090-65b091402449 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.393403 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e185b-9b3b-456d-85be-2b9a3b566d14 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.449313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b259ba2-ec6b-4612-88c7-61a642c983eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.449932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b259ba2-ec6b-4612-88c7-61a642c983eb admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.450218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b259ba2-ec6b-4612-88c7-61a642c983eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.450507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b259ba2-ec6b-4612-88c7-61a642c983eb admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.450696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:14.451157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b259ba2-ec6b-4612-88c7-61a642c983eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:14.451499 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b259ba2-ec6b-4612-88c7-61a642c983eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.453097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b259ba2-ec6b-4612-88c7-61a642c983eb admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.454923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e812f1a-714d-4e7c-b090-65b091402449 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.461350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51bdec-4638-41f6-bc7e-97b10bd56778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.462046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51bdec-4638-41f6-bc7e-97b10bd56778 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.462333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51bdec-4638-41f6-bc7e-97b10bd56778 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.462608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51bdec-4638-41f6-bc7e-97b10bd56778 admin admin] PATH_INFO: `/v3/projects/a5cb91358b814419be8b1e7e73691e7f/users/b3afb5c7305d4162b32e57385d949af6/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.465820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 622/1236] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:14.467025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565a82-dacf-4278-9266-45a9907536ef None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.467339 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565a82-dacf-4278-9266-45a9907536ef None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.467624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565a82-dacf-4278-9266-45a9907536ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.485627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51bdec-4638-41f6-bc7e-97b10bd56778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5cb91358b814419be8b1e7e73691e7f, user_id=b3afb5c7305d4162b32e57385d949af6, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.486626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-57565a82-dacf-4278-9266-45a9907536ef None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.487858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-57565a82-dacf-4278-9266-45a9907536ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.488375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51bdec-4638-41f6-bc7e-97b10bd56778 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.496548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 623/1237] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.497715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b63a9-9bf0-4a7a-9168-10353541e518 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.498006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b63a9-9bf0-4a7a-9168-10353541e518 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.498287 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b63a9-9bf0-4a7a-9168-10353541e518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.504937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 615/1238] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:14 2022] PUT /identity/v3/projects/a5cb91358b814419be8b1e7e73691e7f/users/b3afb5c7305d4162b32e57385d949af6/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:14.506178 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51bdec-4638-41f6-bc7e-97b10bd56778 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.513178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:14.518682 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b47b63a9-9bf0-4a7a-9168-10353541e518 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.519988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b47b63a9-9bf0-4a7a-9168-10353541e518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.575608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51bdec-4638-41f6-bc7e-97b10bd56778 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.580265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb551cc-877a-4279-8d90-d5b541b9f28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.580880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb551cc-877a-4279-8d90-d5b541b9f28b admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.581159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb551cc-877a-4279-8d90-d5b541b9f28b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.581432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb551cc-877a-4279-8d90-d5b541b9f28b admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.582339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb551cc-877a-4279-8d90-d5b541b9f28b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:14.582470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb551cc-877a-4279-8d90-d5b541b9f28b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.584285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb551cc-877a-4279-8d90-d5b541b9f28b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.591106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 624/1239] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.595877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596d58-4514-42c2-b073-72486bbfd768 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.596175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596d58-4514-42c2-b073-72486bbfd768 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.596371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 616/1240] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:14.596505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596d58-4514-42c2-b073-72486bbfd768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.597561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189a3c-1ec9-44b0-8a40-3826d22889a0 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.597845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189a3c-1ec9-44b0-8a40-3826d22889a0 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.598119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189a3c-1ec9-44b0-8a40-3826d22889a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.615442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-e5596d58-4514-42c2-b073-72486bbfd768 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.616563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e5596d58-4514-42c2-b073-72486bbfd768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.617802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e8189a3c-1ec9-44b0-8a40-3826d22889a0 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.618964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e8189a3c-1ec9-44b0-8a40-3826d22889a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.625003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 625/1241] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.625760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5596d58-4514-42c2-b073-72486bbfd768 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.629820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 617/1242] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.630652 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8189a3c-1ec9-44b0-8a40-3826d22889a0 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.635267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5596d58-4514-42c2-b073-72486bbfd768 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.639879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8189a3c-1ec9-44b0-8a40-3826d22889a0 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.640151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c181b-ee8f-44d3-9d1f-58491c113374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.640743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c181b-ee8f-44d3-9d1f-58491c113374 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.641019 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c181b-ee8f-44d3-9d1f-58491c113374 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.641288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c181b-ee8f-44d3-9d1f-58491c113374 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.641904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c181b-ee8f-44d3-9d1f-58491c113374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.643010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WARNING py.warnings [None req-682c181b-ee8f-44d3-9d1f-58491c113374 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:49:14.643010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: warnings.warn(msg) Oct 12 04:49:14.643010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: Oct 12 04:49:14.644285 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c181b-ee8f-44d3-9d1f-58491c113374 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.645270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80afb0-f8d9-4ccb-8081-a4fa2b6495de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.645864 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80afb0-f8d9-4ccb-8081-a4fa2b6495de admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.646159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80afb0-f8d9-4ccb-8081-a4fa2b6495de admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.646420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80afb0-f8d9-4ccb-8081-a4fa2b6495de admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.647067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80afb0-f8d9-4ccb-8081-a4fa2b6495de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.649017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80afb0-f8d9-4ccb-8081-a4fa2b6495de admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.670278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 626/1243] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:14.670278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c181b-ee8f-44d3-9d1f-58491c113374 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.681264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c181b-ee8f-44d3-9d1f-58491c113374 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.683121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 618/1244] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:14.684474 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56c1b-ceab-4161-b47b-003c765c5f6a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.684779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56c1b-ceab-4161-b47b-003c765c5f6a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.686039 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56c1b-ceab-4161-b47b-003c765c5f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.705559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b2b56c1b-ceab-4161-b47b-003c765c5f6a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:14.706765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b2b56c1b-ceab-4161-b47b-003c765c5f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:14.742609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65e3c-ad2e-4620-9b0c-75f653dbf686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.743325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65e3c-ad2e-4620-9b0c-75f653dbf686 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.743544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65e3c-ad2e-4620-9b0c-75f653dbf686 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.743820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65e3c-ad2e-4620-9b0c-75f653dbf686 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.744593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df65e3c-ad2e-4620-9b0c-75f653dbf686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:14.745394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df65e3c-ad2e-4620-9b0c-75f653dbf686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.746996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df65e3c-ad2e-4620-9b0c-75f653dbf686 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.758222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 627/1245] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:14.759065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65e3c-ad2e-4620-9b0c-75f653dbf686 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.767095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 619/1246] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:14.767942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b56c1b-ceab-4161-b47b-003c765c5f6a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.773007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65e3c-ad2e-4620-9b0c-75f653dbf686 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.777936 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b56c1b-ceab-4161-b47b-003c765c5f6a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.778691 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e886119-3b9b-43f6-8b02-41367b812671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.779324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886119-3b9b-43f6-8b02-41367b812671 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.779611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886119-3b9b-43f6-8b02-41367b812671 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.779886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886119-3b9b-43f6-8b02-41367b812671 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.780528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e886119-3b9b-43f6-8b02-41367b812671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:14.780834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e886119-3b9b-43f6-8b02-41367b812671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.782407 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e886119-3b9b-43f6-8b02-41367b812671 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.782912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f69be-d423-449a-b838-d4ebd2a57d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.783696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f69be-d423-449a-b838-d4ebd2a57d3f admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.784000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f69be-d423-449a-b838-d4ebd2a57d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.784267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f69be-d423-449a-b838-d4ebd2a57d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.784902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f69be-d423-449a-b838-d4ebd2a57d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.786978 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f69be-d423-449a-b838-d4ebd2a57d3f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.795909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 628/1247] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:14.796572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e886119-3b9b-43f6-8b02-41367b812671 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.812735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e886119-3b9b-43f6-8b02-41367b812671 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.817844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422c554-9a5c-4a8b-a734-efda648a0d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.818449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c554-9a5c-4a8b-a734-efda648a0d15 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.818728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c554-9a5c-4a8b-a734-efda648a0d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.819003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c554-9a5c-4a8b-a734-efda648a0d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.819681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422c554-9a5c-4a8b-a734-efda648a0d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:14.819986 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422c554-9a5c-4a8b-a734-efda648a0d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.821610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422c554-9a5c-4a8b-a734-efda648a0d15 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.821805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 620/1248] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:14.826301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f69be-d423-449a-b838-d4ebd2a57d3f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.834104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 629/1249] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:14.834906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422c554-9a5c-4a8b-a734-efda648a0d15 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.844878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422c554-9a5c-4a8b-a734-efda648a0d15 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.857163 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:14.893023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:14.894656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f69be-d423-449a-b838-d4ebd2a57d3f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.899801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e198ed-84fe-4514-b605-854d462fe8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.900416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e198ed-84fe-4514-b605-854d462fe8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.900705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e198ed-84fe-4514-b605-854d462fe8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.900993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e198ed-84fe-4514-b605-854d462fe8d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.901681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e198ed-84fe-4514-b605-854d462fe8d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:14.901992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e198ed-84fe-4514-b605-854d462fe8d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.903505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17342d56-9f4e-49ab-816c-97f3af190af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.903644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e198ed-84fe-4514-b605-854d462fe8d6 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.904115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17342d56-9f4e-49ab-816c-97f3af190af7 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.904397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17342d56-9f4e-49ab-816c-97f3af190af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.904677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17342d56-9f4e-49ab-816c-97f3af190af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.905481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17342d56-9f4e-49ab-816c-97f3af190af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.907545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17342d56-9f4e-49ab-816c-97f3af190af7 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.921777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 621/1250] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:14.921777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e198ed-84fe-4514-b605-854d462fe8d6 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.922046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 630/1251] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:14.922046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17342d56-9f4e-49ab-816c-97f3af190af7 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.930977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e198ed-84fe-4514-b605-854d462fe8d6 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.931114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17342d56-9f4e-49ab-816c-97f3af190af7 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:14.935621 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03775f4-43f8-4b1c-b82b-42ee29f6140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.935779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31cefa-7ac8-4575-b757-3a8b4c11a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:14.936198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03775f4-43f8-4b1c-b82b-42ee29f6140e admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.936370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31cefa-7ac8-4575-b757-3a8b4c11a585 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:14.936465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03775f4-43f8-4b1c-b82b-42ee29f6140e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.936656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31cefa-7ac8-4575-b757-3a8b4c11a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:14.936752 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03775f4-43f8-4b1c-b82b-42ee29f6140e admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.936933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31cefa-7ac8-4575-b757-3a8b4c11a585 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:14.937325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03775f4-43f8-4b1c-b82b-42ee29f6140e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.937550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31cefa-7ac8-4575-b757-3a8b4c11a585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:14.939187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03775f4-43f8-4b1c-b82b-42ee29f6140e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.939467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31cefa-7ac8-4575-b757-3a8b4c11a585 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:14.962670 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 622/1252] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:14.963782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31cefa-7ac8-4575-b757-3a8b4c11a585 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:14.968473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 631/1253] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:14.969276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03775f4-43f8-4b1c-b82b-42ee29f6140e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.021025 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31cefa-7ac8-4575-b757-3a8b4c11a585 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.031348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03775f4-43f8-4b1c-b82b-42ee29f6140e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.036360 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822111e0-7de4-4abd-964e-5daba61e08d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.036971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822111e0-7de4-4abd-964e-5daba61e08d6 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.037260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822111e0-7de4-4abd-964e-5daba61e08d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.037534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822111e0-7de4-4abd-964e-5daba61e08d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.038158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822111e0-7de4-4abd-964e-5daba61e08d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.040095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822111e0-7de4-4abd-964e-5daba61e08d6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.070288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 632/1254] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:14 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:15.070288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822111e0-7de4-4abd-964e-5daba61e08d6 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.071378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fd630-8e45-43f6-b69d-8a6a25aed3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.072001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fd630-8e45-43f6-b69d-8a6a25aed3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.072292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fd630-8e45-43f6-b69d-8a6a25aed3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.072566 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fd630-8e45-43f6-b69d-8a6a25aed3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.082546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fd630-8e45-43f6-b69d-8a6a25aed3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.084287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fd630-8e45-43f6-b69d-8a6a25aed3f6 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.093975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 623/1255] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:15.094933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fd630-8e45-43f6-b69d-8a6a25aed3f6 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.103813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fd630-8e45-43f6-b69d-8a6a25aed3f6 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.136456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822111e0-7de4-4abd-964e-5daba61e08d6 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.142198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619261f-10fc-4b0c-95e2-eb47aa4f980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.144014 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619261f-10fc-4b0c-95e2-eb47aa4f980d admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.144331 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619261f-10fc-4b0c-95e2-eb47aa4f980d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.144616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619261f-10fc-4b0c-95e2-eb47aa4f980d admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.145491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619261f-10fc-4b0c-95e2-eb47aa4f980d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.147515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619261f-10fc-4b0c-95e2-eb47aa4f980d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.169176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acbe1d-62c6-40aa-91ac-955ce6edf34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.170510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acbe1d-62c6-40aa-91ac-955ce6edf34f admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.170510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acbe1d-62c6-40aa-91ac-955ce6edf34f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.170901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acbe1d-62c6-40aa-91ac-955ce6edf34f admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.171670 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acbe1d-62c6-40aa-91ac-955ce6edf34f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.176658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 633/1256] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:15 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:15.176840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acbe1d-62c6-40aa-91ac-955ce6edf34f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.176951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619261f-10fc-4b0c-95e2-eb47aa4f980d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.180044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:15.186716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619261f-10fc-4b0c-95e2-eb47aa4f980d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.191953 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c904387-b0e1-4105-a305-d5a5cf12aff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.192703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c904387-b0e1-4105-a305-d5a5cf12aff8 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.193086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c904387-b0e1-4105-a305-d5a5cf12aff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.193564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c904387-b0e1-4105-a305-d5a5cf12aff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.194301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c904387-b0e1-4105-a305-d5a5cf12aff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.196179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c904387-b0e1-4105-a305-d5a5cf12aff8 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.211412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 634/1257] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.211412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c904387-b0e1-4105-a305-d5a5cf12aff8 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.212263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 624/1258] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:15 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:15.214024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acbe1d-62c6-40aa-91ac-955ce6edf34f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.223002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c904387-b0e1-4105-a305-d5a5cf12aff8 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.253413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:15.290097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f74321-6079-4c37-a2ca-18712288b651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.290767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74321-6079-4c37-a2ca-18712288b651 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.291046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74321-6079-4c37-a2ca-18712288b651 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.291388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74321-6079-4c37-a2ca-18712288b651 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.292039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f74321-6079-4c37-a2ca-18712288b651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.293931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acbe1d-62c6-40aa-91ac-955ce6edf34f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.294066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f74321-6079-4c37-a2ca-18712288b651 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.300209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861366d9-8791-49d2-9e9c-1c64eaa5c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.301244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861366d9-8791-49d2-9e9c-1c64eaa5c362 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.301244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861366d9-8791-49d2-9e9c-1c64eaa5c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.301462 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861366d9-8791-49d2-9e9c-1c64eaa5c362 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.302022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861366d9-8791-49d2-9e9c-1c64eaa5c362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.303685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861366d9-8791-49d2-9e9c-1c64eaa5c362 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.314602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 625/1259] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.315374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861366d9-8791-49d2-9e9c-1c64eaa5c362 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.327160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861366d9-8791-49d2-9e9c-1c64eaa5c362 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.332955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 635/1260] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:15 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:15.332955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f74321-6079-4c37-a2ca-18712288b651 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.335610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d3ace-42bb-4032-995c-36df8d068238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.336229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3ace-42bb-4032-995c-36df8d068238 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.336867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3ace-42bb-4032-995c-36df8d068238 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.336867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3ace-42bb-4032-995c-36df8d068238 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.337384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d3ace-42bb-4032-995c-36df8d068238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.339857 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d3ace-42bb-4032-995c-36df8d068238 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.369657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 626/1261] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:15 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:15.369657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d3ace-42bb-4032-995c-36df8d068238 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.382730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d3ace-42bb-4032-995c-36df8d068238 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.418848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f74321-6079-4c37-a2ca-18712288b651 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.426732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f2a0-6034-48ce-9075-4b10be50b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.427889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f2a0-6034-48ce-9075-4b10be50b65a admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.428241 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f2a0-6034-48ce-9075-4b10be50b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.428581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f2a0-6034-48ce-9075-4b10be50b65a admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.429534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29f2a0-6034-48ce-9075-4b10be50b65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.433008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29f2a0-6034-48ce-9075-4b10be50b65a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.446222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987059-5159-4294-bc31-f91ec2b29a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.446222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987059-5159-4294-bc31-f91ec2b29a9d admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.446222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987059-5159-4294-bc31-f91ec2b29a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.446619 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987059-5159-4294-bc31-f91ec2b29a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.447233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987059-5159-4294-bc31-f91ec2b29a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.449128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987059-5159-4294-bc31-f91ec2b29a9d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.459963 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 636/1262] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:15 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:15.460688 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f2a0-6034-48ce-9075-4b10be50b65a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.468304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 627/1263] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.468304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987059-5159-4294-bc31-f91ec2b29a9d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.471276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f2a0-6034-48ce-9075-4b10be50b65a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.476355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc03e5b-afd5-431d-9524-8ffdbfc37fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.477183 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03e5b-afd5-431d-9524-8ffdbfc37fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.477464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03e5b-afd5-431d-9524-8ffdbfc37fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.477815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03e5b-afd5-431d-9524-8ffdbfc37fd9 admin admin] PATH_INFO: `/v3/projects/8918611760dd4530a0c84897b65d615a/users/8e0e1102073242f2bb6d53b0af011f61/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.480345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987059-5159-4294-bc31-f91ec2b29a9d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.486115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1cb3d-a995-4be8-a5b3-28b98609efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.487056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1cb3d-a995-4be8-a5b3-28b98609efdb admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.487822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1cb3d-a995-4be8-a5b3-28b98609efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.488300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1cb3d-a995-4be8-a5b3-28b98609efdb admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.489215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1cb3d-a995-4be8-a5b3-28b98609efdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.492063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1cb3d-a995-4be8-a5b3-28b98609efdb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.495406 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc03e5b-afd5-431d-9524-8ffdbfc37fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8918611760dd4530a0c84897b65d615a, user_id=8e0e1102073242f2bb6d53b0af011f61, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.498463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc03e5b-afd5-431d-9524-8ffdbfc37fd9 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.514512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 637/1264] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:15 2022] PUT /identity/v3/projects/8918611760dd4530a0c84897b65d615a/users/8e0e1102073242f2bb6d53b0af011f61/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:15.515404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc03e5b-afd5-431d-9524-8ffdbfc37fd9 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.527132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 628/1265] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:15 2022] POST /identity/v3/users => generated 293 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:15.528559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1cb3d-a995-4be8-a5b3-28b98609efdb admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.551818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1cb3d-a995-4be8-a5b3-28b98609efdb admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.607547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc03e5b-afd5-431d-9524-8ffdbfc37fd9 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.613064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:15.616242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f5ef8-7ff4-4833-815b-b91d927ab14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.617553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f5ef8-7ff4-4833-815b-b91d927ab14e admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.617918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f5ef8-7ff4-4833-815b-b91d927ab14e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.618819 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f5ef8-7ff4-4833-815b-b91d927ab14e admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.620077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f5ef8-7ff4-4833-815b-b91d927ab14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.623073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f5ef8-7ff4-4833-815b-b91d927ab14e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.637652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 638/1266] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.638518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f5ef8-7ff4-4833-815b-b91d927ab14e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.643763 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba761ad7-2a80-4820-8c78-673759697ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.644398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba761ad7-2a80-4820-8c78-673759697ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.644680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba761ad7-2a80-4820-8c78-673759697ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.644954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba761ad7-2a80-4820-8c78-673759697ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.645593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba761ad7-2a80-4820-8c78-673759697ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.647587 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba761ad7-2a80-4820-8c78-673759697ec6 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.650441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f5ef8-7ff4-4833-815b-b91d927ab14e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.656055 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf8f99-1e63-4b22-8945-9e795a882589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.656847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf8f99-1e63-4b22-8945-9e795a882589 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.657133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf8f99-1e63-4b22-8945-9e795a882589 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.657414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf8f99-1e63-4b22-8945-9e795a882589 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.658102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf8f99-1e63-4b22-8945-9e795a882589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.660914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf8f99-1e63-4b22-8945-9e795a882589 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.675178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 639/1268] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.675876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 629/1268] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:15 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:15.676741 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf8f99-1e63-4b22-8945-9e795a882589 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.676911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba761ad7-2a80-4820-8c78-673759697ec6 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.684855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:15.688563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba761ad7-2a80-4820-8c78-673759697ec6 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.689703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf8f99-1e63-4b22-8945-9e795a882589 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.695897 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae5839-b239-4e42-96c6-f087048b0275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.696138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484454bf-569a-4aad-8bfc-1904ff9dc78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.696559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484454bf-569a-4aad-8bfc-1904ff9dc78f admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.696883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484454bf-569a-4aad-8bfc-1904ff9dc78f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.697330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484454bf-569a-4aad-8bfc-1904ff9dc78f admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.698461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5839-b239-4e42-96c6-f087048b0275 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.698570 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484454bf-569a-4aad-8bfc-1904ff9dc78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.698734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5839-b239-4e42-96c6-f087048b0275 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.699100 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5839-b239-4e42-96c6-f087048b0275 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.699784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae5839-b239-4e42-96c6-f087048b0275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.700368 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484454bf-569a-4aad-8bfc-1904ff9dc78f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.701422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae5839-b239-4e42-96c6-f087048b0275 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.719476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 630/1269] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.719687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 640/1270] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.719687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae5839-b239-4e42-96c6-f087048b0275 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.719862 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586561e-5688-480f-a654-705a6f49295a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.719862 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586561e-5688-480f-a654-705a6f49295a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.719862 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586561e-5688-480f-a654-705a6f49295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.730519 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae5839-b239-4e42-96c6-f087048b0275 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.735251 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfb7ea-3772-43c3-ad54-4e77f501b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.735905 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfb7ea-3772-43c3-ad54-4e77f501b6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.736189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfb7ea-3772-43c3-ad54-4e77f501b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.736464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfb7ea-3772-43c3-ad54-4e77f501b6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.737100 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfb7ea-3772-43c3-ad54-4e77f501b6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.738698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfb7ea-3772-43c3-ad54-4e77f501b6e2 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.750007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-f586561e-5688-480f-a654-705a6f49295a None None] MFA Rules not processed for user `8e0e1102073242f2bb6d53b0af011f61`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:15.751246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f586561e-5688-480f-a654-705a6f49295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:15.752933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 641/1271] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.753846 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfb7ea-3772-43c3-ad54-4e77f501b6e2 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.769243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfb7ea-3772-43c3-ad54-4e77f501b6e2 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.774696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ccd2d-8c81-48df-8d25-01820f0f0f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.775406 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ccd2d-8c81-48df-8d25-01820f0f0f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.775694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ccd2d-8c81-48df-8d25-01820f0f0f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.776030 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ccd2d-8c81-48df-8d25-01820f0f0f1c admin admin] PATH_INFO: `/v3/projects/ce1c1d48b29a4e03ac03aac2ebaf0c57/users/beff795898ae42ae8ca96c3ccc00a31f/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.792181 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ccd2d-8c81-48df-8d25-01820f0f0f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c1d48b29a4e03ac03aac2ebaf0c57, user_id=beff795898ae42ae8ca96c3ccc00a31f, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.794929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ccd2d-8c81-48df-8d25-01820f0f0f1c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.810203 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 642/1272] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:15 2022] PUT /identity/v3/projects/ce1c1d48b29a4e03ac03aac2ebaf0c57/users/beff795898ae42ae8ca96c3ccc00a31f/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:15.811121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ccd2d-8c81-48df-8d25-01820f0f0f1c admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.827593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 631/1273] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:15.828451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586561e-5688-480f-a654-705a6f49295a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.845185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586561e-5688-480f-a654-705a6f49295a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.896355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ccd2d-8c81-48df-8d25-01820f0f0f1c admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.902172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffb470-22c6-477b-9280-c167ff4400e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.904815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffb470-22c6-477b-9280-c167ff4400e3 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.904815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffb470-22c6-477b-9280-c167ff4400e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.904815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffb470-22c6-477b-9280-c167ff4400e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.904815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffb470-22c6-477b-9280-c167ff4400e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.906402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffb470-22c6-477b-9280-c167ff4400e3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.917844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 643/1274] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.918556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffb470-22c6-477b-9280-c167ff4400e3 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.918929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c8ab-538a-43d1-8075-d770029e29b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.919614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c8ab-538a-43d1-8075-d770029e29b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.919901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c8ab-538a-43d1-8075-d770029e29b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.920168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c8ab-538a-43d1-8075-d770029e29b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.920851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49c8ab-538a-43d1-8075-d770029e29b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.922508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49c8ab-538a-43d1-8075-d770029e29b6 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.930323 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffb470-22c6-477b-9280-c167ff4400e3 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.937074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 632/1275] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.937074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c8ab-538a-43d1-8075-d770029e29b6 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.939316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822ae2c-207f-44ed-b0f3-4670fec45ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.939874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822ae2c-207f-44ed-b0f3-4670fec45ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.940155 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822ae2c-207f-44ed-b0f3-4670fec45ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.940429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822ae2c-207f-44ed-b0f3-4670fec45ad4 admin admin] PATH_INFO: `/v3/projects/5268af0c10444c3d9342068a919121b9/users/94fe5ae1c52648fc9507216f4ab8d240/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.946250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c8ab-538a-43d1-8075-d770029e29b6 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:15.952527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b771ab-a928-4555-b0b3-6c21b6fe5c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:15.953536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b771ab-a928-4555-b0b3-6c21b6fe5c99 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.953909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b771ab-a928-4555-b0b3-6c21b6fe5c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.954258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b771ab-a928-4555-b0b3-6c21b6fe5c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.955032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b771ab-a928-4555-b0b3-6c21b6fe5c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.957435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822ae2c-207f-44ed-b0f3-4670fec45ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5268af0c10444c3d9342068a919121b9, user_id=94fe5ae1c52648fc9507216f4ab8d240, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:15.957923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b771ab-a928-4555-b0b3-6c21b6fe5c99 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.961488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822ae2c-207f-44ed-b0f3-4670fec45ad4 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:15.972189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 633/1276] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:15.973378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b771ab-a928-4555-b0b3-6c21b6fe5c99 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:15.988610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 644/1277] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:15 2022] PUT /identity/v3/projects/5268af0c10444c3d9342068a919121b9/users/94fe5ae1c52648fc9507216f4ab8d240/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:15.988610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d13809-d7e6-408d-8ec8-c454ec78ce6e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:15.988610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d13809-d7e6-408d-8ec8-c454ec78ce6e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:15.988610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d13809-d7e6-408d-8ec8-c454ec78ce6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:15.995973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b771ab-a928-4555-b0b3-6c21b6fe5c99 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:16.013363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d0d13809-d7e6-408d-8ec8-c454ec78ce6e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:16.014669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d0d13809-d7e6-408d-8ec8-c454ec78ce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:16.035898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:16.070362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83579b-7271-4d69-8b5a-fe3d217b75b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:16.070992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83579b-7271-4d69-8b5a-fe3d217b75b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.071600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83579b-7271-4d69-8b5a-fe3d217b75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.071796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83579b-7271-4d69-8b5a-fe3d217b75b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.072533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83579b-7271-4d69-8b5a-fe3d217b75b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:16.074198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83579b-7271-4d69-8b5a-fe3d217b75b3 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:16.085307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 634/1278] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:16.086478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba113cf-c826-4b16-bddf-ee0627591c8a None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.086773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba113cf-c826-4b16-bddf-ee0627591c8a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.087051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba113cf-c826-4b16-bddf-ee0627591c8a None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.089231 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 635/1279] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 04:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:49:16.089949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba113cf-c826-4b16-bddf-ee0627591c8a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:16.106477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba113cf-c826-4b16-bddf-ee0627591c8a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:16.111834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3e735-cc47-45cf-8b1b-e6d5b5806b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:16.112634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e735-cc47-45cf-8b1b-e6d5b5806b11 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.113100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e735-cc47-45cf-8b1b-e6d5b5806b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.113480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e735-cc47-45cf-8b1b-e6d5b5806b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.114229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3e735-cc47-45cf-8b1b-e6d5b5806b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:16.115587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 645/1280] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:16.116302 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3e735-cc47-45cf-8b1b-e6d5b5806b11 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:16.116534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d13809-d7e6-408d-8ec8-c454ec78ce6e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:16.128336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d13809-d7e6-408d-8ec8-c454ec78ce6e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:16.128497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 636/1281] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:16.129504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3e735-cc47-45cf-8b1b-e6d5b5806b11 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:16.135420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97fcdf-7b6a-433a-988d-9517b90a334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:16.136955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97fcdf-7b6a-433a-988d-9517b90a334e admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.137640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97fcdf-7b6a-433a-988d-9517b90a334e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.137928 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97fcdf-7b6a-433a-988d-9517b90a334e admin admin] PATH_INFO: `/v3/projects/7ff4531fbbd840fd90ed18953580fbf7/users/65d7e0e126ba4259b39283ab582a3345/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.141028 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3e735-cc47-45cf-8b1b-e6d5b5806b11 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:16.146906 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3832d-09ad-4517-a509-735fcddd5bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:16.147694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3832d-09ad-4517-a509-735fcddd5bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.148691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3832d-09ad-4517-a509-735fcddd5bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.148988 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3832d-09ad-4517-a509-735fcddd5bcd admin admin] PATH_INFO: `/v3/projects/d3cfd4ef43ab4a52b6af5874d4f7755e/users/17b09e0e38e04824bf449ff2a843e8d0/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.158168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97fcdf-7b6a-433a-988d-9517b90a334e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff4531fbbd840fd90ed18953580fbf7, user_id=65d7e0e126ba4259b39283ab582a3345, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:16.162042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97fcdf-7b6a-433a-988d-9517b90a334e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:16.169883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3832d-09ad-4517-a509-735fcddd5bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cfd4ef43ab4a52b6af5874d4f7755e, user_id=17b09e0e38e04824bf449ff2a843e8d0, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:16.173914 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3832d-09ad-4517-a509-735fcddd5bcd admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:16.180914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 646/1282] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:16 2022] PUT /identity/v3/projects/7ff4531fbbd840fd90ed18953580fbf7/users/65d7e0e126ba4259b39283ab582a3345/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:16.185189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5415c53-ef77-4f8b-9b79-0a962353caca None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.185189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5415c53-ef77-4f8b-9b79-0a962353caca None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.185189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5415c53-ef77-4f8b-9b79-0a962353caca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.190268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 637/1283] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:16 2022] PUT /identity/v3/projects/d3cfd4ef43ab4a52b6af5874d4f7755e/users/17b09e0e38e04824bf449ff2a843e8d0/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:16.191511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3832d-09ad-4517-a509-735fcddd5bcd admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:16.208743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:16.215948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-f5415c53-ef77-4f8b-9b79-0a962353caca None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:16.217875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f5415c53-ef77-4f8b-9b79-0a962353caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:16.281804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3832d-09ad-4517-a509-735fcddd5bcd admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:16.287124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc4ae6-0a61-4478-9212-ac8a774b7828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:16.288021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc4ae6-0a61-4478-9212-ac8a774b7828 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.288315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc4ae6-0a61-4478-9212-ac8a774b7828 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.288734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc4ae6-0a61-4478-9212-ac8a774b7828 admin admin] PATH_INFO: `/v3/projects/9f254371cfae4015be1c6ebb2d7041e1/users/02a6a3c31407479ba496e282b3d75261/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.300425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 647/1284] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:16.300425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b4893-8053-4dab-b8d2-3d6db29300da None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.300425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b4893-8053-4dab-b8d2-3d6db29300da None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.300425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b4893-8053-4dab-b8d2-3d6db29300da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.310225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc4ae6-0a61-4478-9212-ac8a774b7828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f254371cfae4015be1c6ebb2d7041e1, user_id=02a6a3c31407479ba496e282b3d75261, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:16.315307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc4ae6-0a61-4478-9212-ac8a774b7828 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:16.335369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 638/1285] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:16 2022] PUT /identity/v3/projects/9f254371cfae4015be1c6ebb2d7041e1/users/02a6a3c31407479ba496e282b3d75261/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:16.336639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc4ae6-0a61-4478-9212-ac8a774b7828 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:16.357740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-726b4893-8053-4dab-b8d2-3d6db29300da None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:16.358980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-726b4893-8053-4dab-b8d2-3d6db29300da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:16.407562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc4ae6-0a61-4478-9212-ac8a774b7828 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:16.412209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8c38-d758-4ad1-8f79-d3fb6233789a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:16.412824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8c38-d758-4ad1-8f79-d3fb6233789a service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.413236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8c38-d758-4ad1-8f79-d3fb6233789a service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.413602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8c38-d758-4ad1-8f79-d3fb6233789a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.446297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 648/1286] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:16.447163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b4893-8053-4dab-b8d2-3d6db29300da None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:16.460187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:16.499662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8c38-d758-4ad1-8f79-d3fb6233789a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:16.502355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8c38-d758-4ad1-8f79-d3fb6233789a service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:16.514919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 639/1287] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:16.516740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206027f-49a7-47e2-9f82-70ae08d213b7 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.517317 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206027f-49a7-47e2-9f82-70ae08d213b7 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.517807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206027f-49a7-47e2-9f82-70ae08d213b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.522074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b4893-8053-4dab-b8d2-3d6db29300da None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:16.527162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d58554-f83d-4df3-978e-887de386ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:16.527882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58554-f83d-4df3-978e-887de386ca65 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.528162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58554-f83d-4df3-978e-887de386ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.528992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58554-f83d-4df3-978e-887de386ca65 admin admin] PATH_INFO: `/v3/projects/7b54976e77874071ba6c6bff18307830/users/27163a5d9f534c6eb584c1bf0fdd0502/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.542144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-4206027f-49a7-47e2-9f82-70ae08d213b7 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:16.543945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4206027f-49a7-47e2-9f82-70ae08d213b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:16.547477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d58554-f83d-4df3-978e-887de386ca65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b54976e77874071ba6c6bff18307830, user_id=27163a5d9f534c6eb584c1bf0fdd0502, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:16.550433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d58554-f83d-4df3-978e-887de386ca65 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:16.563881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 640/1288] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:16.563992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26265998-2a8a-4760-af73-7f7de9a093fe None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.564301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26265998-2a8a-4760-af73-7f7de9a093fe None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.564632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26265998-2a8a-4760-af73-7f7de9a093fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.582796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 649/1289] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:16 2022] PUT /identity/v3/projects/7b54976e77874071ba6c6bff18307830/users/27163a5d9f534c6eb584c1bf0fdd0502/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:16.586059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d58554-f83d-4df3-978e-887de386ca65 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:16.611989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:16.646346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-26265998-2a8a-4760-af73-7f7de9a093fe None None] MFA Rules not processed for user `17b09e0e38e04824bf449ff2a843e8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:16.647908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-26265998-2a8a-4760-af73-7f7de9a093fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:16.689573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d58554-f83d-4df3-978e-887de386ca65 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:16.697727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ddca1-2aff-452f-b17e-7420fde8d397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:16.698397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ddca1-2aff-452f-b17e-7420fde8d397 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.698739 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ddca1-2aff-452f-b17e-7420fde8d397 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.699023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ddca1-2aff-452f-b17e-7420fde8d397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.827590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ddca1-2aff-452f-b17e-7420fde8d397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:16.829136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ddca1-2aff-452f-b17e-7420fde8d397 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:16.833122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 641/1290] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:16.834831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61257c-ff4b-44a0-a30b-bbd71a183708 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:16.835146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61257c-ff4b-44a0-a30b-bbd71a183708 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:16.835450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61257c-ff4b-44a0-a30b-bbd71a183708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:16.864424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 650/1291] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:16.865374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ddca1-2aff-452f-b17e-7420fde8d397 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:16.903742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-3c61257c-ff4b-44a0-a30b-bbd71a183708 None None] MFA Rules not processed for user `02a6a3c31407479ba496e282b3d75261`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:16.905002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-3c61257c-ff4b-44a0-a30b-bbd71a183708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:16.996647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ddca1-2aff-452f-b17e-7420fde8d397 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.006189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb03f5a-2949-4af4-92f2-311035407e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.006973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb03f5a-2949-4af4-92f2-311035407e90 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.007498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb03f5a-2949-4af4-92f2-311035407e90 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.007873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb03f5a-2949-4af4-92f2-311035407e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.039121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 642/1292] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:17.040582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44048660-c0b5-463c-b21f-fd619182fc23 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.041716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44048660-c0b5-463c-b21f-fd619182fc23 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.041716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44048660-c0b5-463c-b21f-fd619182fc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.159032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-44048660-c0b5-463c-b21f-fd619182fc23 None None] MFA Rules not processed for user `27163a5d9f534c6eb584c1bf0fdd0502`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:17.159032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-44048660-c0b5-463c-b21f-fd619182fc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:17.169374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:17.169374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb03f5a-2949-4af4-92f2-311035407e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.169374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb03f5a-2949-4af4-92f2-311035407e90 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.173080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 651/1293] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:17.174349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb03f5a-2949-4af4-92f2-311035407e90 service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.186419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb03f5a-2949-4af4-92f2-311035407e90 service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.190902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54b34c-781f-461b-8b8b-a4ef3fcb34e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.191940 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54b34c-781f-461b-8b8b-a4ef3fcb34e4 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.192398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54b34c-781f-461b-8b8b-a4ef3fcb34e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.192855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54b34c-781f-461b-8b8b-a4ef3fcb34e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.195098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:17.212512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54b34c-781f-461b-8b8b-a4ef3fcb34e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.214753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54b34c-781f-461b-8b8b-a4ef3fcb34e4 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.226052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 652/1294] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:17.227000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54b34c-781f-461b-8b8b-a4ef3fcb34e4 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.240287 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54b34c-781f-461b-8b8b-a4ef3fcb34e4 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.249892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d5026-7afa-4115-9844-4b75bfeaca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.250511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5026-7afa-4115-9844-4b75bfeaca72 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.250797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5026-7afa-4115-9844-4b75bfeaca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.253022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5026-7afa-4115-9844-4b75bfeaca72 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.253804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d5026-7afa-4115-9844-4b75bfeaca72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.254853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 643/1295] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:17.257361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e7e0-9417-4692-a6a0-22fe9cf74181 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.257881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e7e0-9417-4692-a6a0-22fe9cf74181 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.260772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e7e0-9417-4692-a6a0-22fe9cf74181 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.261538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d5026-7afa-4115-9844-4b75bfeaca72 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.272578 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 644/1296] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 04:49:17 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:49:17.274603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514e7e0-9417-4692-a6a0-22fe9cf74181 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.293536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514e7e0-9417-4692-a6a0-22fe9cf74181 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.305832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b7cf1-5a12-4fd8-9ddb-a55135b7bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.306883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b7cf1-5a12-4fd8-9ddb-a55135b7bd7d admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.307000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 653/1297] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:17 2022] POST /identity/v3/projects => generated 405 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:17.307636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b7cf1-5a12-4fd8-9ddb-a55135b7bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.308156 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b7cf1-5a12-4fd8-9ddb-a55135b7bd7d admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.309107 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b7cf1-5a12-4fd8-9ddb-a55135b7bd7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.310372 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e100d-fe6e-4e91-bb28-cdabd2b6b3d1 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.310868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e100d-fe6e-4e91-bb28-cdabd2b6b3d1 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.311162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e100d-fe6e-4e91-bb28-cdabd2b6b3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.313724 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b7cf1-5a12-4fd8-9ddb-a55135b7bd7d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.334856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-865e100d-fe6e-4e91-bb28-cdabd2b6b3d1 None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:17.336197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-865e100d-fe6e-4e91-bb28-cdabd2b6b3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:17.356287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 645/1298] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:17 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:17.358126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b7cf1-5a12-4fd8-9ddb-a55135b7bd7d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.444186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b7cf1-5a12-4fd8-9ddb-a55135b7bd7d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.450836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 654/1299] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 04:49:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:17.452086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e100d-fe6e-4e91-bb28-cdabd2b6b3d1 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.455886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb085ef-318b-4f28-bbde-76849feeb31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.456539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb085ef-318b-4f28-bbde-76849feeb31f admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.456866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb085ef-318b-4f28-bbde-76849feeb31f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.457088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb085ef-318b-4f28-bbde-76849feeb31f admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.457816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb085ef-318b-4f28-bbde-76849feeb31f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.460180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb085ef-318b-4f28-bbde-76849feeb31f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.490516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 646/1300] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:17 2022] POST /identity/v3/users => generated 309 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:17.491408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb085ef-318b-4f28-bbde-76849feeb31f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.540730 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e100d-fe6e-4e91-bb28-cdabd2b6b3d1 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.547674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ad890-3b60-482f-99d1-3e910cb56885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.548695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ad890-3b60-482f-99d1-3e910cb56885 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.549078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ad890-3b60-482f-99d1-3e910cb56885 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.549397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ad890-3b60-482f-99d1-3e910cb56885 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.550501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ad890-3b60-482f-99d1-3e910cb56885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.552589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ad890-3b60-482f-99d1-3e910cb56885 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.581263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb085ef-318b-4f28-bbde-76849feeb31f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.585484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 655/1301] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:17 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:17.585484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba8af4-03d1-47f6-b141-a47d3abc13a3 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.585484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba8af4-03d1-47f6-b141-a47d3abc13a3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.585484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba8af4-03d1-47f6-b141-a47d3abc13a3 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.587357 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 656/1302] 10.222.0.18 () {54 vars in 912 bytes} [Wed Oct 12 04:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:49:17.587357 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba8af4-03d1-47f6-b141-a47d3abc13a3 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.595889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c25150-2ca6-453a-b1bc-15ff0cc9c109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.596568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c25150-2ca6-453a-b1bc-15ff0cc9c109 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.596851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c25150-2ca6-453a-b1bc-15ff0cc9c109 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.597125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c25150-2ca6-453a-b1bc-15ff0cc9c109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.602586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba8af4-03d1-47f6-b141-a47d3abc13a3 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.608337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b2015-d086-4144-b1cc-ebe393abb64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.609161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b2015-d086-4144-b1cc-ebe393abb64e admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.609641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b2015-d086-4144-b1cc-ebe393abb64e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.610113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b2015-d086-4144-b1cc-ebe393abb64e admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.611047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b2015-d086-4144-b1cc-ebe393abb64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.612752 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b2015-d086-4144-b1cc-ebe393abb64e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.627932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 657/1303] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:17.629047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b2015-d086-4144-b1cc-ebe393abb64e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.635153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:17.644480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b2015-d086-4144-b1cc-ebe393abb64e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.652481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf4856-a7b7-418e-b413-7ddb6fe885d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.653390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf4856-a7b7-418e-b413-7ddb6fe885d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.653554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf4856-a7b7-418e-b413-7ddb6fe885d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.653734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf4856-a7b7-418e-b413-7ddb6fe885d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.654332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf4856-a7b7-418e-b413-7ddb6fe885d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.656503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf4856-a7b7-418e-b413-7ddb6fe885d5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.674300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 658/1304] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:17.675504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eefe2-5bdd-4b4b-801b-4422021836a2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.675789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eefe2-5bdd-4b4b-801b-4422021836a2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.676065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eefe2-5bdd-4b4b-801b-4422021836a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.691346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c25150-2ca6-453a-b1bc-15ff0cc9c109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.693189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c25150-2ca6-453a-b1bc-15ff0cc9c109 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.707435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-713eefe2-5bdd-4b4b-801b-4422021836a2 None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:17.708551 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-713eefe2-5bdd-4b4b-801b-4422021836a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:17.715487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 647/1305] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:17.716879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c25150-2ca6-453a-b1bc-15ff0cc9c109 service nova] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.730829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 659/1306] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:49:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:17.731462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eefe2-5bdd-4b4b-801b-4422021836a2 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.733653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c25150-2ca6-453a-b1bc-15ff0cc9c109 service nova] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.740958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b36f-5ac7-456f-8cd2-0b62120c8ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.749485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eefe2-5bdd-4b4b-801b-4422021836a2 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.749722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b36f-5ac7-456f-8cd2-0b62120c8ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.750487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b36f-5ac7-456f-8cd2-0b62120c8ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.751191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b36f-5ac7-456f-8cd2-0b62120c8ab7 admin admin] PATH_INFO: `/v3/projects/d9d0c32e05ce4269ad8effc1c8b29e54/users/bad701f915e94f17b56a00270f7fce24/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.754925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27940d-7a72-4aa9-a848-c821430be288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.755847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27940d-7a72-4aa9-a848-c821430be288 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.756193 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27940d-7a72-4aa9-a848-c821430be288 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.756534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27940d-7a72-4aa9-a848-c821430be288 admin admin] PATH_INFO: `/v3/projects/17b3b36f2cb446ec828d52483b0e9c43/users/ec8c193ada284c5a8be02f55c951e93e/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.771077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:17.785999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9b36f-5ac7-456f-8cd2-0b62120c8ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d0c32e05ce4269ad8effc1c8b29e54, user_id=bad701f915e94f17b56a00270f7fce24, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.787488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27940d-7a72-4aa9-a848-c821430be288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b3b36f2cb446ec828d52483b0e9c43, user_id=ec8c193ada284c5a8be02f55c951e93e, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.789664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9b36f-5ac7-456f-8cd2-0b62120c8ab7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.790942 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27940d-7a72-4aa9-a848-c821430be288 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.810333 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 660/1307] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:17 2022] PUT /identity/v3/projects/17b3b36f2cb446ec828d52483b0e9c43/users/ec8c193ada284c5a8be02f55c951e93e/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:17.812475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27940d-7a72-4aa9-a848-c821430be288 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.844534 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 648/1308] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:17 2022] PUT /identity/v3/projects/d9d0c32e05ce4269ad8effc1c8b29e54/users/bad701f915e94f17b56a00270f7fce24/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:17.849707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b36f-5ac7-456f-8cd2-0b62120c8ab7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:17.890105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27940d-7a72-4aa9-a848-c821430be288 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.976737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b36f-5ac7-456f-8cd2-0b62120c8ab7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:17.984681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae89f08-3045-4f0f-a110-84e477c2a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.985463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae89f08-3045-4f0f-a110-84e477c2a254 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:17.985751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae89f08-3045-4f0f-a110-84e477c2a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:17.986123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae89f08-3045-4f0f-a110-84e477c2a254 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:17.986775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae89f08-3045-4f0f-a110-84e477c2a254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:17.988885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae89f08-3045-4f0f-a110-84e477c2a254 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:17.997972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd985b-2bcd-4dc7-8d21-fd1599a3acfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:17.999916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd985b-2bcd-4dc7-8d21-fd1599a3acfb service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:18.000222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd985b-2bcd-4dc7-8d21-fd1599a3acfb service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:18.000506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd985b-2bcd-4dc7-8d21-fd1599a3acfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:18.002636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 649/1309] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:18.004352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae89f08-3045-4f0f-a110-84e477c2a254 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:18.019152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae89f08-3045-4f0f-a110-84e477c2a254 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:18.025879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fdfbf-c4a9-493a-9bd2-693b868b6d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:18.026959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fdfbf-c4a9-493a-9bd2-693b868b6d66 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:18.027356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fdfbf-c4a9-493a-9bd2-693b868b6d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:18.027722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fdfbf-c4a9-493a-9bd2-693b868b6d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:18.028629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fdfbf-c4a9-493a-9bd2-693b868b6d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:18.030827 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fdfbf-c4a9-493a-9bd2-693b868b6d66 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:18.045820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 650/1310] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:18.046739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fdfbf-c4a9-493a-9bd2-693b868b6d66 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:18.060738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fdfbf-c4a9-493a-9bd2-693b868b6d66 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:18.068804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19c472-8886-468f-b5bf-4d71e2a0f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:18.069723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19c472-8886-468f-b5bf-4d71e2a0f69e admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:18.070100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19c472-8886-468f-b5bf-4d71e2a0f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:18.070513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19c472-8886-468f-b5bf-4d71e2a0f69e admin admin] PATH_INFO: `/v3/projects/17b3b36f2cb446ec828d52483b0e9c43/users/ec8c193ada284c5a8be02f55c951e93e/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:18.073620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19c472-8886-468f-b5bf-4d71e2a0f69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b3b36f2cb446ec828d52483b0e9c43, user_id=ec8c193ada284c5a8be02f55c951e93e, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:18.076824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19c472-8886-468f-b5bf-4d71e2a0f69e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:18.090829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 651/1311] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:18 2022] PUT /identity/v3/projects/17b3b36f2cb446ec828d52483b0e9c43/users/ec8c193ada284c5a8be02f55c951e93e/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:18.091904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19c472-8886-468f-b5bf-4d71e2a0f69e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:18.151997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd985b-2bcd-4dc7-8d21-fd1599a3acfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:18.153453 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd985b-2bcd-4dc7-8d21-fd1599a3acfb service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:18.170528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 661/1312] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:18.171968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d8e0-99ba-41b8-bba2-5359a0bcc3ab None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:18.172335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d8e0-99ba-41b8-bba2-5359a0bcc3ab None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:18.172617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d8e0-99ba-41b8-bba2-5359a0bcc3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:18.221422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19c472-8886-468f-b5bf-4d71e2a0f69e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:18.222948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a8d2d8e0-99ba-41b8-bba2-5359a0bcc3ab None None] MFA Rules not processed for user `ec8c193ada284c5a8be02f55c951e93e`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:18.224625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a8d2d8e0-99ba-41b8-bba2-5359a0bcc3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:18.235310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43644c-810d-4b9b-b11c-cc767aa44f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:18.239778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43644c-810d-4b9b-b11c-cc767aa44f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:18.239778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43644c-810d-4b9b-b11c-cc767aa44f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:18.239778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43644c-810d-4b9b-b11c-cc767aa44f64 admin admin] PATH_INFO: `/v3/projects/d9d0c32e05ce4269ad8effc1c8b29e54/users/bad701f915e94f17b56a00270f7fce24/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:18.239778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43644c-810d-4b9b-b11c-cc767aa44f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d0c32e05ce4269ad8effc1c8b29e54, user_id=bad701f915e94f17b56a00270f7fce24, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:18.244012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43644c-810d-4b9b-b11c-cc767aa44f64 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:18.275726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 652/1313] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:18 2022] PUT /identity/v3/projects/d9d0c32e05ce4269ad8effc1c8b29e54/users/bad701f915e94f17b56a00270f7fce24/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:18.278297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e06b87-30ac-489b-8a84-fcfd6c862444 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:18.278590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e06b87-30ac-489b-8a84-fcfd6c862444 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:18.278851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e06b87-30ac-489b-8a84-fcfd6c862444 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:18.282351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 653/1314] 10.222.0.18 () {54 vars in 912 bytes} [Wed Oct 12 04:49:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:49:18.287246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be878c89-6f71-4d6d-b163-52f42721e654 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:18.287550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be878c89-6f71-4d6d-b163-52f42721e654 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:18.287809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be878c89-6f71-4d6d-b163-52f42721e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:18.307777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:18.347640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-be878c89-6f71-4d6d-b163-52f42721e654 None None] MFA Rules not processed for user `bad701f915e94f17b56a00270f7fce24`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:18.349773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-be878c89-6f71-4d6d-b163-52f42721e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:18.360982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:18.384911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 662/1315] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:18.386292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57ec3-9797-42dc-a7e1-60ccab028838 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:18.386584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57ec3-9797-42dc-a7e1-60ccab028838 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:18.386915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57ec3-9797-42dc-a7e1-60ccab028838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:18.410612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-1ac57ec3-9797-42dc-a7e1-60ccab028838 None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:18.411962 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1ac57ec3-9797-42dc-a7e1-60ccab028838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:18.509545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 663/1316] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:49:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:18.510490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac57ec3-9797-42dc-a7e1-60ccab028838 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:18.519910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 654/1317] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:18.631825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac57ec3-9797-42dc-a7e1-60ccab028838 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:18.638941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f800c6-e268-43ba-a6aa-bb7d109bfbc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:18.639985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f800c6-e268-43ba-a6aa-bb7d109bfbc4 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:18.640424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f800c6-e268-43ba-a6aa-bb7d109bfbc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:18.640803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f800c6-e268-43ba-a6aa-bb7d109bfbc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:18.809753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f800c6-e268-43ba-a6aa-bb7d109bfbc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:18.813197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f800c6-e268-43ba-a6aa-bb7d109bfbc4 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:18.852237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 664/1318] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:18.949054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be878c89-6f71-4d6d-b163-52f42721e654 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:18.989942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be878c89-6f71-4d6d-b163-52f42721e654 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:19.004713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad2dd7-9cb3-4cdf-b635-08adf7223b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:19.005355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad2dd7-9cb3-4cdf-b635-08adf7223b64 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:19.006420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad2dd7-9cb3-4cdf-b635-08adf7223b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:19.006833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad2dd7-9cb3-4cdf-b635-08adf7223b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:19.025277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad2dd7-9cb3-4cdf-b635-08adf7223b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:19.028961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad2dd7-9cb3-4cdf-b635-08adf7223b64 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:19.048543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 655/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:19.179799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f800c6-e268-43ba-a6aa-bb7d109bfbc4 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:19.195744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f800c6-e268-43ba-a6aa-bb7d109bfbc4 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:19.208019 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbad4f4-1088-4a37-b20a-c5b5a6d6a6f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:19.208902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbad4f4-1088-4a37-b20a-c5b5a6d6a6f3 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:19.209265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbad4f4-1088-4a37-b20a-c5b5a6d6a6f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:19.209542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbad4f4-1088-4a37-b20a-c5b5a6d6a6f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:19.228131 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbad4f4-1088-4a37-b20a-c5b5a6d6a6f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:19.230002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbad4f4-1088-4a37-b20a-c5b5a6d6a6f3 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:19.236288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:19.254522 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 665/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:19 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:20.058153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad2dd7-9cb3-4cdf-b635-08adf7223b64 service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:20.189454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad2dd7-9cb3-4cdf-b635-08adf7223b64 service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:20.195502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:20.197445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:20.199133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:20.199712 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] PATH_INFO: `/v3/users/17b09e0e38e04824bf449ff2a843e8d0` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:20.201134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b09e0e38e04824bf449ff2a843e8d0)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:20.202318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: WARNING py.warnings [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:49:20.202318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: warnings.warn(msg) Oct 12 04:49:20.202318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: Oct 12 04:49:20.204143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:20.369925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b09e0e38e04824bf449ff2a843e8d0'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:20.393156 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b09e0e38e04824bf449ff2a843e8d0'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:20.394385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b09e0e38e04824bf449ff2a843e8d0'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:20.395208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b09e0e38e04824bf449ff2a843e8d0'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:20.409703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b09e0e38e04824bf449ff2a843e8d0'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:20.444187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 656/1321] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:20 2022] DELETE /identity/v3/users/17b09e0e38e04824bf449ff2a843e8d0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:20.451746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ad6a9-3ad1-4b45-b5ba-42748c4a55a8 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:20.452242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ad6a9-3ad1-4b45-b5ba-42748c4a55a8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:20.452528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ad6a9-3ad1-4b45-b5ba-42748c4a55a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:20.485644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:20.488403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:20.504403 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a42ad6a9-3ad1-4b45-b5ba-42748c4a55a8 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:20.507263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a42ad6a9-3ad1-4b45-b5ba-42748c4a55a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:20.522475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:20.676198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81657956-3294-4bd7-95ce-75fa96a7f4c2 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:20.684156 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:20.685595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:20.685992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:20.686963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] PATH_INFO: `/v3/users/27163a5d9f534c6eb584c1bf0fdd0502` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:20.688311 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=27163a5d9f534c6eb584c1bf0fdd0502)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:20.690838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:20.699717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 666/1322] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:20.737784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ad6a9-3ad1-4b45-b5ba-42748c4a55a8 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:20.740445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a42ad6a9-3ad1-4b45-b5ba-42748c4a55a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:20.794490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27163a5d9f534c6eb584c1bf0fdd0502'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:20.814383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27163a5d9f534c6eb584c1bf0fdd0502'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:20.815996 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27163a5d9f534c6eb584c1bf0fdd0502'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:20.816769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27163a5d9f534c6eb584c1bf0fdd0502'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:20.830038 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-263fed38-5d6b-498b-b496-b954d2c1f8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27163a5d9f534c6eb584c1bf0fdd0502'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:20.879145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 657/1323] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:20 2022] DELETE /identity/v3/users/27163a5d9f534c6eb584c1bf0fdd0502 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:20.884316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263c00-8a8f-4ec1-8046-59f15f227117 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:20.884316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263c00-8a8f-4ec1-8046-59f15f227117 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:20.884316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263c00-8a8f-4ec1-8046-59f15f227117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:20.892128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ad6a9-3ad1-4b45-b5ba-42748c4a55a8 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:20.935073 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-dc263c00-8a8f-4ec1-8046-59f15f227117 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:20.937112 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dc263c00-8a8f-4ec1-8046-59f15f227117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:21.003029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e2159-86ff-4596-a030-62b6dfcc5d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:21.003790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e2159-86ff-4596-a030-62b6dfcc5d6e service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:21.004151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e2159-86ff-4596-a030-62b6dfcc5d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:21.005607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e2159-86ff-4596-a030-62b6dfcc5d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:21.008206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-018e2159-86ff-4596-a030-62b6dfcc5d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:21.068374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 658/1324] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:21.182815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e2159-86ff-4596-a030-62b6dfcc5d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:21.184553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e2159-86ff-4596-a030-62b6dfcc5d6e service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:21.197931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc263c00-8a8f-4ec1-8046-59f15f227117 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:21.199613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dc263c00-8a8f-4ec1-8046-59f15f227117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:21.221100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc263c00-8a8f-4ec1-8046-59f15f227117 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:21.229839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b1de2-5ef6-4642-b4ed-dba92ab58a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:21.230408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b1de2-5ef6-4642-b4ed-dba92ab58a08 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:21.230700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b1de2-5ef6-4642-b4ed-dba92ab58a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:21.230979 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b1de2-5ef6-4642-b4ed-dba92ab58a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:21.254734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 667/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:49:21.256352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b1de2-5ef6-4642-b4ed-dba92ab58a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:21.258318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b1de2-5ef6-4642-b4ed-dba92ab58a08 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:21.283353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 659/1326] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:49:22.749081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e2159-86ff-4596-a030-62b6dfcc5d6e service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:22.753805 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-018e2159-86ff-4596-a030-62b6dfcc5d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:22.805656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e2159-86ff-4596-a030-62b6dfcc5d6e service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:22.816359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:22.817191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:22.817623 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:22.818051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] PATH_INFO: `/v3/projects/d3cfd4ef43ab4a52b6af5874d4f7755e` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:22.820977 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3cfd4ef43ab4a52b6af5874d4f7755e)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:22.822901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: WARNING py.warnings [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 04:49:22.822901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: warnings.warn(msg) Oct 12 04:49:22.822901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: Oct 12 04:49:22.824698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:22.828187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:22.935531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b1de2-5ef6-4642-b4ed-dba92ab58a08 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:22.939073 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6f6b1de2-5ef6-4642-b4ed-dba92ab58a08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:22.966329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b1de2-5ef6-4642-b4ed-dba92ab58a08 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:23.011260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:23.014049 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3cfd4ef43ab4a52b6af5874d4f7755e', 'request_id': 'req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.030378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3cfd4ef43ab4a52b6af5874d4f7755e', 'request_id': 'req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.070364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3cfd4ef43ab4a52b6af5874d4f7755e', 'request_id': 'req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.092081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] The token cache is being invalidate because project d3cfd4ef43ab4a52b6af5874d4f7755e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:23.092627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.093869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.096127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 668/1327] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:22 2022] DELETE /identity/v3/projects/d3cfd4ef43ab4a52b6af5874d4f7755e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:23.100887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:23.102623 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:23.173486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:23.175991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:23.176616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:23.177120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] PATH_INFO: `/v3/users/8e0e1102073242f2bb6d53b0af011f61` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:23.184298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0e1102073242f2bb6d53b0af011f61)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:23.188003 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:23.216310 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef473a6-2c4e-499a-abb5-4d26dfd3205c admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:23.225983 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:23.226954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:23.228111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:23.228111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] PATH_INFO: `/v3/users/bad701f915e94f17b56a00270f7fce24` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:23.230870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad701f915e94f17b56a00270f7fce24)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:23.234950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:23.302079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad701f915e94f17b56a00270f7fce24'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.308726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0e1102073242f2bb6d53b0af011f61'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.312300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad701f915e94f17b56a00270f7fce24'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.313255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad701f915e94f17b56a00270f7fce24'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.314139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad701f915e94f17b56a00270f7fce24'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.325977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0e1102073242f2bb6d53b0af011f61'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.326279 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-574d4da3-e1f4-4089-8917-ca069eac7adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad701f915e94f17b56a00270f7fce24'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.327734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0e1102073242f2bb6d53b0af011f61'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.330027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0e1102073242f2bb6d53b0af011f61'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.349053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0e1102073242f2bb6d53b0af011f61'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:23.376820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 669/1328] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:23 2022] DELETE /identity/v3/users/bad701f915e94f17b56a00270f7fce24 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:23.397829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 660/1329] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:22 2022] DELETE /identity/v3/users/8e0e1102073242f2bb6d53b0af011f61 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:49:23.399618 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963619c-5769-4dec-881f-aca38294dd2b None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:23.399909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963619c-5769-4dec-881f-aca38294dd2b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:23.400189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963619c-5769-4dec-881f-aca38294dd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:23.671046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a963619c-5769-4dec-881f-aca38294dd2b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:23.672288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a963619c-5769-4dec-881f-aca38294dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:23.680748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:23.823750 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 670/1330] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:23.851496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:23.852976 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:24.012836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d56194-f256-4650-86de-8a064cc0e2a5 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:24.037260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430625fd-3547-4b1a-883c-ebd7f51ccf25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:24.037921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430625fd-3547-4b1a-883c-ebd7f51ccf25 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:24.038205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430625fd-3547-4b1a-883c-ebd7f51ccf25 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:24.038691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430625fd-3547-4b1a-883c-ebd7f51ccf25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:24.073557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430625fd-3547-4b1a-883c-ebd7f51ccf25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:24.075135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430625fd-3547-4b1a-883c-ebd7f51ccf25 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:24.097937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 661/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:24.641030 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963619c-5769-4dec-881f-aca38294dd2b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:24.642741 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a963619c-5769-4dec-881f-aca38294dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:24.683340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963619c-5769-4dec-881f-aca38294dd2b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:24.693382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:24.695052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:24.695365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:24.700086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] PATH_INFO: `/v3/projects/7b54976e77874071ba6c6bff18307830` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:24.704228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b54976e77874071ba6c6bff18307830)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:24.710702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:24.832631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b54976e77874071ba6c6bff18307830', 'request_id': 'req-6daefd25-3fb8-4a0c-87f4-633beec8b314'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:24.851036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b54976e77874071ba6c6bff18307830', 'request_id': 'req-6daefd25-3fb8-4a0c-87f4-633beec8b314'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:24.873999 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b54976e77874071ba6c6bff18307830', 'request_id': 'req-6daefd25-3fb8-4a0c-87f4-633beec8b314'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:24.921841 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] The token cache is being invalidate because project 7b54976e77874071ba6c6bff18307830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:24.922148 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:24.922872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:24.924924 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 671/1332] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:24 2022] DELETE /identity/v3/projects/7b54976e77874071ba6c6bff18307830 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:24.928758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430625fd-3547-4b1a-883c-ebd7f51ccf25 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:24.942482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430625fd-3547-4b1a-883c-ebd7f51ccf25 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:25.096618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:25.188955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:25.189623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:25.190524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:25.190807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] PATH_INFO: `/v3/users/ec8c193ada284c5a8be02f55c951e93e` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:25.195361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8c193ada284c5a8be02f55c951e93e)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:25.197371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:25.277435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:25.278887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:25.305952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daefd25-3fb8-4a0c-87f4-633beec8b314 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:25.328504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:25.328504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:25.328755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:25.328997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] PATH_INFO: `/v3/users/02a6a3c31407479ba496e282b3d75261` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:25.332495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a6a3c31407479ba496e282b3d75261)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:25.334929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:25.337928 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8c193ada284c5a8be02f55c951e93e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.347804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8c193ada284c5a8be02f55c951e93e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.349028 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8c193ada284c5a8be02f55c951e93e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.350285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8c193ada284c5a8be02f55c951e93e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.366275 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0e8f2312-c8ef-4613-81ea-08efe0e123a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8c193ada284c5a8be02f55c951e93e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.396637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 662/1333] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:24 2022] DELETE /identity/v3/users/ec8c193ada284c5a8be02f55c951e93e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:25.447105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a6a3c31407479ba496e282b3d75261'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.460231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a6a3c31407479ba496e282b3d75261'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.462821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a6a3c31407479ba496e282b3d75261'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.463672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a6a3c31407479ba496e282b3d75261'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.481565 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a6a3c31407479ba496e282b3d75261'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.517140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 672/1334] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:25 2022] DELETE /identity/v3/users/02a6a3c31407479ba496e282b3d75261 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:49:25.522909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078e1a-1ce5-407e-8333-9c4dbec57559 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:25.523584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078e1a-1ce5-407e-8333-9c4dbec57559 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:25.524233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078e1a-1ce5-407e-8333-9c4dbec57559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:25.575059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e9078e1a-1ce5-407e-8333-9c4dbec57559 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:25.582637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e9078e1a-1ce5-407e-8333-9c4dbec57559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:25.703744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:25.705217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:25.709417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 663/1335] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:25.722355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:25.738055 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180b74-6e6f-47be-a1f5-6f4a4d2661bd admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:25.753484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:25.754159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:25.754437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:25.754878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] PATH_INFO: `/v3/projects/d9d0c32e05ce4269ad8effc1c8b29e54` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:25.756922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d0c32e05ce4269ad8effc1c8b29e54)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:25.759063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:25.804001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078e1a-1ce5-407e-8333-9c4dbec57559 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:25.810179 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e9078e1a-1ce5-407e-8333-9c4dbec57559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:25.867664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d0c32e05ce4269ad8effc1c8b29e54', 'request_id': 'req-2dca34c8-869f-4e45-a836-bea60edb7adf'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.882458 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d0c32e05ce4269ad8effc1c8b29e54', 'request_id': 'req-2dca34c8-869f-4e45-a836-bea60edb7adf'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.901096 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d0c32e05ce4269ad8effc1c8b29e54', 'request_id': 'req-2dca34c8-869f-4e45-a836-bea60edb7adf'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.923991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078e1a-1ce5-407e-8333-9c4dbec57559 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:25.928164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] The token cache is being invalidate because project d9d0c32e05ce4269ad8effc1c8b29e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:25.928462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.931804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2dca34c8-869f-4e45-a836-bea60edb7adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:25.936189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 673/1336] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:25 2022] DELETE /identity/v3/projects/d9d0c32e05ce4269ad8effc1c8b29e54 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:49:25.940221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2898d-2673-46b0-be61-00eda80eeab3 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:25.940516 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2898d-2673-46b0-be61-00eda80eeab3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:25.940793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2898d-2673-46b0-be61-00eda80eeab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:25.947559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:25.986218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-32c2898d-2673-46b0-be61-00eda80eeab3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:25.988891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-32c2898d-2673-46b0-be61-00eda80eeab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:26.020647 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0825e5-2320-48b8-8dc7-02f477c7689f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:26.021865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0825e5-2320-48b8-8dc7-02f477c7689f service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:26.022350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0825e5-2320-48b8-8dc7-02f477c7689f service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:26.022794 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0825e5-2320-48b8-8dc7-02f477c7689f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:26.026413 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ba0825e5-2320-48b8-8dc7-02f477c7689f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:26.126364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 674/1337] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:26.135839 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfae90-de9b-45ad-b19f-8fe2ef378607 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:26.136131 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfae90-de9b-45ad-b19f-8fe2ef378607 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:26.136415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfae90-de9b-45ad-b19f-8fe2ef378607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:26.177950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d3bfae90-de9b-45ad-b19f-8fe2ef378607 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:26.181367 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d3bfae90-de9b-45ad-b19f-8fe2ef378607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:26.200710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 675/1338] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:26.204747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfae90-de9b-45ad-b19f-8fe2ef378607 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:26.220981 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfae90-de9b-45ad-b19f-8fe2ef378607 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:26.240200 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8362f-6ab5-4c7b-8f1e-5f8d0fc4c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:26.240832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8362f-6ab5-4c7b-8f1e-5f8d0fc4c632 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:26.241109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0825e5-2320-48b8-8dc7-02f477c7689f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:26.241564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8362f-6ab5-4c7b-8f1e-5f8d0fc4c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:26.241564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8362f-6ab5-4c7b-8f1e-5f8d0fc4c632 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:26.242021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8362f-6ab5-4c7b-8f1e-5f8d0fc4c632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:26.242326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8362f-6ab5-4c7b-8f1e-5f8d0fc4c632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:26.242595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0825e5-2320-48b8-8dc7-02f477c7689f service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:26.244672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8362f-6ab5-4c7b-8f1e-5f8d0fc4c632 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:26.267065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 664/1339] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:26.271071 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 676/1340] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:49:26.280233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0825e5-2320-48b8-8dc7-02f477c7689f service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:26.299930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0825e5-2320-48b8-8dc7-02f477c7689f service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:26.315504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97d198-33a8-4a98-950c-5bd9d13c6058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:26.316319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d198-33a8-4a98-950c-5bd9d13c6058 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:26.319901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d198-33a8-4a98-950c-5bd9d13c6058 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:26.320383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d198-33a8-4a98-950c-5bd9d13c6058 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:26.321225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97d198-33a8-4a98-950c-5bd9d13c6058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:26.323423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97d198-33a8-4a98-950c-5bd9d13c6058 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:26.379981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 665/1341] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:26 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:26.384053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8362f-6ab5-4c7b-8f1e-5f8d0fc4c632 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:26.394203 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8362f-6ab5-4c7b-8f1e-5f8d0fc4c632 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:26.502865 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc56f9c-b7d8-4d73-96bd-9b8c8f9b966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:26.504714 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc56f9c-b7d8-4d73-96bd-9b8c8f9b966e admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:26.506509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc56f9c-b7d8-4d73-96bd-9b8c8f9b966e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:26.508162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc56f9c-b7d8-4d73-96bd-9b8c8f9b966e admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:26.510767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc56f9c-b7d8-4d73-96bd-9b8c8f9b966e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:26.514872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc56f9c-b7d8-4d73-96bd-9b8c8f9b966e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:26.559082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:26.577393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 677/1342] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:26 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:26.579532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97d198-33a8-4a98-950c-5bd9d13c6058 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:26.591412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97d198-33a8-4a98-950c-5bd9d13c6058 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:26.598351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7229446-e2f7-4263-be7c-4cce5413cc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:26.599205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7229446-e2f7-4263-be7c-4cce5413cc8a admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:26.599843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7229446-e2f7-4263-be7c-4cce5413cc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:26.600473 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7229446-e2f7-4263-be7c-4cce5413cc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:26.601364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7229446-e2f7-4263-be7c-4cce5413cc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:26.603455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7229446-e2f7-4263-be7c-4cce5413cc8a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:26.618831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 666/1343] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:26.625513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc56f9c-b7d8-4d73-96bd-9b8c8f9b966e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:26.660285 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc56f9c-b7d8-4d73-96bd-9b8c8f9b966e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:26.671914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a715f-ec9e-4b12-8cdb-fbaf9a271393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:26.672689 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a715f-ec9e-4b12-8cdb-fbaf9a271393 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:26.672804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a715f-ec9e-4b12-8cdb-fbaf9a271393 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:26.672998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a715f-ec9e-4b12-8cdb-fbaf9a271393 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:26.673817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a715f-ec9e-4b12-8cdb-fbaf9a271393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:26.675716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a715f-ec9e-4b12-8cdb-fbaf9a271393 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:26.701880 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 678/1344] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:26.706312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7229446-e2f7-4263-be7c-4cce5413cc8a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:26.726352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7229446-e2f7-4263-be7c-4cce5413cc8a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:26.732843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b978-d816-46d8-b994-95c6491531be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:26.734436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b978-d816-46d8-b994-95c6491531be admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:26.736958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b978-d816-46d8-b994-95c6491531be admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:26.737523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b978-d816-46d8-b994-95c6491531be admin admin] PATH_INFO: `/v3/projects/3a2b6fb98b5e4723ab5c192693ff9d70/users/fe079a88ac224ad5a3ba45dde745517c/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:26.744959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a715f-ec9e-4b12-8cdb-fbaf9a271393 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:26.747664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-136a715f-ec9e-4b12-8cdb-fbaf9a271393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:26.774690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a715f-ec9e-4b12-8cdb-fbaf9a271393 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:26.789533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:26.793882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:26.794158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:26.795486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] PATH_INFO: `/v3/projects/8918611760dd4530a0c84897b65d615a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:26.797240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66b978-d816-46d8-b994-95c6491531be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2b6fb98b5e4723ab5c192693ff9d70, user_id=fe079a88ac224ad5a3ba45dde745517c, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:26.800531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8918611760dd4530a0c84897b65d615a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:26.804370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:26.805167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66b978-d816-46d8-b994-95c6491531be admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:26.840547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 667/1345] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:26 2022] PUT /identity/v3/projects/3a2b6fb98b5e4723ab5c192693ff9d70/users/fe079a88ac224ad5a3ba45dde745517c/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:26.842586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697481-f18c-444a-8dab-127a0aa0592e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:26.843407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697481-f18c-444a-8dab-127a0aa0592e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:26.843407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697481-f18c-444a-8dab-127a0aa0592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:26.891996 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-1f697481-f18c-444a-8dab-127a0aa0592e None None] MFA Rules not processed for user `fe079a88ac224ad5a3ba45dde745517c`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:26.893470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1f697481-f18c-444a-8dab-127a0aa0592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:26.934412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8918611760dd4530a0c84897b65d615a', 'request_id': 'req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:26.960085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8918611760dd4530a0c84897b65d615a', 'request_id': 'req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:26.970163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8918611760dd4530a0c84897b65d615a', 'request_id': 'req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:27.006425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] The token cache is being invalidate because project 8918611760dd4530a0c84897b65d615a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:27.006724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:27.009441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89cfd2e5-5e07-4ca9-ac2d-d173b9d42f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:27.013996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 679/1346] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:26 2022] DELETE /identity/v3/projects/8918611760dd4530a0c84897b65d615a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:27.018587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ad248-ff77-4ff2-be7f-86e6d265a775 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.018881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ad248-ff77-4ff2-be7f-86e6d265a775 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.019161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ad248-ff77-4ff2-be7f-86e6d265a775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.063693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-5f4ad248-ff77-4ff2-be7f-86e6d265a775 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:27.063863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:27.064934 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5f4ad248-ff77-4ff2-be7f-86e6d265a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:27.087107 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 668/1347] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:27.095073 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f697481-f18c-444a-8dab-127a0aa0592e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:27.100719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1f697481-f18c-444a-8dab-127a0aa0592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:27.292907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f697481-f18c-444a-8dab-127a0aa0592e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:27.299402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecd3d6-5421-49bd-85e2-6a060445ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:27.300137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecd3d6-5421-49bd-85e2-6a060445ff86 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.300437 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecd3d6-5421-49bd-85e2-6a060445ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.300718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecd3d6-5421-49bd-85e2-6a060445ff86 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.301372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecd3d6-5421-49bd-85e2-6a060445ff86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:27.301793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 680/1348] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:27.303213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ad248-ff77-4ff2-be7f-86e6d265a775 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:27.303653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecd3d6-5421-49bd-85e2-6a060445ff86 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:27.304360 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5f4ad248-ff77-4ff2-be7f-86e6d265a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:27.328139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ad248-ff77-4ff2-be7f-86e6d265a775 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:27.342153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:27.342810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.343241 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.343695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] PATH_INFO: `/v3/projects/17b3b36f2cb446ec828d52483b0e9c43` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.345854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b3b36f2cb446ec828d52483b0e9c43)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:27.347988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:27.372371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 669/1349] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:27 2022] POST /identity/v3/projects => generated 369 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:27.374136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937aa4d-e31d-4c35-ac06-6b71e31bd6e3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.374446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937aa4d-e31d-4c35-ac06-6b71e31bd6e3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.374735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937aa4d-e31d-4c35-ac06-6b71e31bd6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.417964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-9937aa4d-e31d-4c35-ac06-6b71e31bd6e3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:27.419555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9937aa4d-e31d-4c35-ac06-6b71e31bd6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:27.453203 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b3b36f2cb446ec828d52483b0e9c43', 'request_id': 'req-3446691b-0a71-4298-adee-759e87c26f0e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:27.468970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b3b36f2cb446ec828d52483b0e9c43', 'request_id': 'req-3446691b-0a71-4298-adee-759e87c26f0e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:27.477440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b3b36f2cb446ec828d52483b0e9c43', 'request_id': 'req-3446691b-0a71-4298-adee-759e87c26f0e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:27.491338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:27.507829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] The token cache is being invalidate because project 17b3b36f2cb446ec828d52483b0e9c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:27.510241 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:27.511975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:27.515922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 681/1350] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:27 2022] DELETE /identity/v3/projects/17b3b36f2cb446ec828d52483b0e9c43 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:27.520308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:27.528288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:27.568007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 670/1351] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:27.569656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562e7d-c4ca-4800-b7eb-f526b2aaa2e2 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.569795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562e7d-c4ca-4800-b7eb-f526b2aaa2e2 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.570187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562e7d-c4ca-4800-b7eb-f526b2aaa2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.628645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446691b-0a71-4298-adee-759e87c26f0e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:27.636347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3f37-8a5c-4f40-9512-8461e4d92d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:27.637365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3f37-8a5c-4f40-9512-8461e4d92d13 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.637867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3f37-8a5c-4f40-9512-8461e4d92d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.638329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3f37-8a5c-4f40-9512-8461e4d92d13 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.639320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3f37-8a5c-4f40-9512-8461e4d92d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:27.640713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-d4562e7d-c4ca-4800-b7eb-f526b2aaa2e2 None None] MFA Rules not processed for user `b3afb5c7305d4162b32e57385d949af6`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:27.641860 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3f37-8a5c-4f40-9512-8461e4d92d13 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:27.644928 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d4562e7d-c4ca-4800-b7eb-f526b2aaa2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:27.687153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 682/1352] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:27 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:27.690473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378e308-3f05-4273-9730-ee60aef5e65b None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.690783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378e308-3f05-4273-9730-ee60aef5e65b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.691068 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378e308-3f05-4273-9730-ee60aef5e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.752844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a378e308-3f05-4273-9730-ee60aef5e65b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:27.758266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a378e308-3f05-4273-9730-ee60aef5e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:27.782356 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 683/1353] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:27.783517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378e308-3f05-4273-9730-ee60aef5e65b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:27.803119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 671/1354] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:27.803119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562e7d-c4ca-4800-b7eb-f526b2aaa2e2 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:27.808692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378e308-3f05-4273-9730-ee60aef5e65b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:27.813909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b52bfb-70be-4a08-9e2f-a45856b3e8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:27.815210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b52bfb-70be-4a08-9e2f-a45856b3e8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.815693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b52bfb-70be-4a08-9e2f-a45856b3e8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.816115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b52bfb-70be-4a08-9e2f-a45856b3e8c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.816931 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b52bfb-70be-4a08-9e2f-a45856b3e8c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:27.817442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b52bfb-70be-4a08-9e2f-a45856b3e8c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:27.818655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562e7d-c4ca-4800-b7eb-f526b2aaa2e2 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:27.819456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b52bfb-70be-4a08-9e2f-a45856b3e8c4 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:27.834289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 684/1355] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:27.834506 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c8fee-4121-4bd4-9809-937b347fecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:27.836377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7e0f-cc29-4e03-9f2d-3e435680265d None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.836854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7e0f-cc29-4e03-9f2d-3e435680265d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.837282 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7e0f-cc29-4e03-9f2d-3e435680265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.837816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c8fee-4121-4bd4-9809-937b347fecd1 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.838341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c8fee-4121-4bd4-9809-937b347fecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.838639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c8fee-4121-4bd4-9809-937b347fecd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.839364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c8fee-4121-4bd4-9809-937b347fecd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:27.844471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c8fee-4121-4bd4-9809-937b347fecd1 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:27.858589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:27.864278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b8ca7e0f-cc29-4e03-9f2d-3e435680265d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:27.865961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b8ca7e0f-cc29-4e03-9f2d-3e435680265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:27.873559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 672/1356] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:27.874683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c8fee-4121-4bd4-9809-937b347fecd1 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:27.877026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-886c8fee-4121-4bd4-9809-937b347fecd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:27.887261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 685/1357] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:27.888148 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca7e0f-cc29-4e03-9f2d-3e435680265d None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:27.926598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca7e0f-cc29-4e03-9f2d-3e435680265d None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:27.938260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d668083-e6ae-47d6-83dd-22a289ebc6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:27.940649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d668083-e6ae-47d6-83dd-22a289ebc6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:27.940925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d668083-e6ae-47d6-83dd-22a289ebc6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:27.941204 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d668083-e6ae-47d6-83dd-22a289ebc6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:27.941852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d668083-e6ae-47d6-83dd-22a289ebc6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:27.949894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d668083-e6ae-47d6-83dd-22a289ebc6e2 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:27.987989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 686/1358] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:27 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:27.987989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d668083-e6ae-47d6-83dd-22a289ebc6e2 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:27.992061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c8fee-4121-4bd4-9809-937b347fecd1 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:28.079925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736b777-92d3-4bbd-961b-25209fc2132e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:28.080664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736b777-92d3-4bbd-961b-25209fc2132e service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:28.080954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736b777-92d3-4bbd-961b-25209fc2132e service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:28.081235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736b777-92d3-4bbd-961b-25209fc2132e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:28.110518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d668083-e6ae-47d6-83dd-22a289ebc6e2 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:28.117520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb3e82-3fe1-41f2-8f4a-56d81bc5c7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:28.118376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb3e82-3fe1-41f2-8f4a-56d81bc5c7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:28.118765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb3e82-3fe1-41f2-8f4a-56d81bc5c7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:28.119145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb3e82-3fe1-41f2-8f4a-56d81bc5c7dd admin admin] PATH_INFO: `/v3/projects/ae6cab0873474afe82e2e81efb53b4b2/users/b0ec118e7aee436da6098f5dda22ac0d/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:28.153867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb3e82-3fe1-41f2-8f4a-56d81bc5c7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6cab0873474afe82e2e81efb53b4b2, user_id=b0ec118e7aee436da6098f5dda22ac0d, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:28.156820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb3e82-3fe1-41f2-8f4a-56d81bc5c7dd admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:28.187911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 687/1359] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:27 2022] PUT /identity/v3/projects/ae6cab0873474afe82e2e81efb53b4b2/users/b0ec118e7aee436da6098f5dda22ac0d/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:28.188937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb3e82-3fe1-41f2-8f4a-56d81bc5c7dd admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:28.236395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:28.282283 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736b777-92d3-4bbd-961b-25209fc2132e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:28.291912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736b777-92d3-4bbd-961b-25209fc2132e service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:28.344955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb3e82-3fe1-41f2-8f4a-56d81bc5c7dd admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:28.354614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818cc74-ec71-4c5a-96bc-0c1d7883b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:28.355270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818cc74-ec71-4c5a-96bc-0c1d7883b640 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:28.356185 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818cc74-ec71-4c5a-96bc-0c1d7883b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:28.356472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818cc74-ec71-4c5a-96bc-0c1d7883b640 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:28.357125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818cc74-ec71-4c5a-96bc-0c1d7883b640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:28.359002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818cc74-ec71-4c5a-96bc-0c1d7883b640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:28.359211 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818cc74-ec71-4c5a-96bc-0c1d7883b640 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:28.364052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 673/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:28.365674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736b777-92d3-4bbd-961b-25209fc2132e service nova] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:28.392414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 688/1361] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:28.393114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818cc74-ec71-4c5a-96bc-0c1d7883b640 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:28.414094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736b777-92d3-4bbd-961b-25209fc2132e service nova] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:28.424208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818cc74-ec71-4c5a-96bc-0c1d7883b640 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:28.426363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcbd36-9f2e-45a0-89b9-0edca939fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:28.427612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcbd36-9f2e-45a0-89b9-0edca939fe35 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:28.428866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcbd36-9f2e-45a0-89b9-0edca939fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:28.431138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcbd36-9f2e-45a0-89b9-0edca939fe35 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:28.439107 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcbd36-9f2e-45a0-89b9-0edca939fe35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:28.439107 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcbd36-9f2e-45a0-89b9-0edca939fe35 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:28.444212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711edd1-6893-4488-bf8c-7ab95ab0fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:28.444852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711edd1-6893-4488-bf8c-7ab95ab0fde3 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:28.445138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711edd1-6893-4488-bf8c-7ab95ab0fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:28.445412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711edd1-6893-4488-bf8c-7ab95ab0fde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:28.446062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711edd1-6893-4488-bf8c-7ab95ab0fde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:28.451605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711edd1-6893-4488-bf8c-7ab95ab0fde3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:28.472198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 674/1362] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:28 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:28.473398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcbd36-9f2e-45a0-89b9-0edca939fe35 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:28.475901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-47bcbd36-9f2e-45a0-89b9-0edca939fe35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:28.486268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 689/1363] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:28.486268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711edd1-6893-4488-bf8c-7ab95ab0fde3 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:28.496367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcbd36-9f2e-45a0-89b9-0edca939fe35 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:28.503015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:28.503848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:28.504260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:28.504638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] PATH_INFO: `/v3/projects/9f254371cfae4015be1c6ebb2d7041e1` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:28.506249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f254371cfae4015be1c6ebb2d7041e1)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:28.508319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:28.525957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711edd1-6893-4488-bf8c-7ab95ab0fde3 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:28.541812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e2ddf-5224-4fc7-94ba-4fb109712d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:28.542845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e2ddf-5224-4fc7-94ba-4fb109712d7a admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:28.542845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e2ddf-5224-4fc7-94ba-4fb109712d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:28.543135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e2ddf-5224-4fc7-94ba-4fb109712d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:28.543919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e2ddf-5224-4fc7-94ba-4fb109712d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:28.545828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e2ddf-5224-4fc7-94ba-4fb109712d7a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:28.584805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:28.621194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 690/1364] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:28 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:28.622074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e2ddf-5224-4fc7-94ba-4fb109712d7a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:28.702878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f254371cfae4015be1c6ebb2d7041e1', 'request_id': 'req-507eecf5-6762-4693-97c1-1940b551c841'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:28.722175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f254371cfae4015be1c6ebb2d7041e1', 'request_id': 'req-507eecf5-6762-4693-97c1-1940b551c841'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:28.745166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f254371cfae4015be1c6ebb2d7041e1', 'request_id': 'req-507eecf5-6762-4693-97c1-1940b551c841'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:28.755469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e2ddf-5224-4fc7-94ba-4fb109712d7a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:28.784315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] The token cache is being invalidate because project 9f254371cfae4015be1c6ebb2d7041e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:28.784315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:28.785695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:28.788518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 675/1365] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:28 2022] DELETE /identity/v3/projects/9f254371cfae4015be1c6ebb2d7041e1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:28.789429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:28.790893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:28.903506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603092a-cd20-41b4-b008-77b7ff3127c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:28.906585 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603092a-cd20-41b4-b008-77b7ff3127c6 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:28.907079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603092a-cd20-41b4-b008-77b7ff3127c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:28.907559 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603092a-cd20-41b4-b008-77b7ff3127c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:28.908499 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603092a-cd20-41b4-b008-77b7ff3127c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:28.912653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603092a-cd20-41b4-b008-77b7ff3127c6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:28.941939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 691/1366] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:28.945097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603092a-cd20-41b4-b008-77b7ff3127c6 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:28.948840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b603092a-cd20-41b4-b008-77b7ff3127c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:28.956056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507eecf5-6762-4693-97c1-1940b551c841 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:28.973343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a69a-069e-47c9-8219-eedd17e86f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:28.974409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a69a-069e-47c9-8219-eedd17e86f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:28.974711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a69a-069e-47c9-8219-eedd17e86f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:28.975088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a69a-069e-47c9-8219-eedd17e86f26 admin admin] PATH_INFO: `/v3/projects/ae6cab0873474afe82e2e81efb53b4b2/users/b0ec118e7aee436da6098f5dda22ac0d/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:28.983045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286a69a-069e-47c9-8219-eedd17e86f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6cab0873474afe82e2e81efb53b4b2, user_id=b0ec118e7aee436da6098f5dda22ac0d, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:28.986959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286a69a-069e-47c9-8219-eedd17e86f26 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:28.991025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603092a-cd20-41b4-b008-77b7ff3127c6 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:29.002865 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d54d4a-52af-4d50-8009-2003009f10ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:29.003522 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54d4a-52af-4d50-8009-2003009f10ce admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.005736 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54d4a-52af-4d50-8009-2003009f10ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.006057 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54d4a-52af-4d50-8009-2003009f10ce admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.006809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d54d4a-52af-4d50-8009-2003009f10ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:29.011840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d54d4a-52af-4d50-8009-2003009f10ce admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:29.026115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 676/1367] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:28 2022] PUT /identity/v3/projects/ae6cab0873474afe82e2e81efb53b4b2/users/b0ec118e7aee436da6098f5dda22ac0d/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:29.026115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61d399-4820-4998-966a-2b23cb10a76d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.026115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61d399-4820-4998-966a-2b23cb10a76d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.026115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61d399-4820-4998-966a-2b23cb10a76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.060737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 692/1368] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:28 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:29.061740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d54d4a-52af-4d50-8009-2003009f10ce admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:29.068698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-88d54d4a-52af-4d50-8009-2003009f10ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:29.072010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0e61d399-4820-4998-966a-2b23cb10a76d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:29.074142 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0e61d399-4820-4998-966a-2b23cb10a76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:29.089044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:29.093549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d54d4a-52af-4d50-8009-2003009f10ce admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:29.208314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 677/1369] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:29.212503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a2ec-cf14-4e75-b41b-34ec37fbb855 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.212911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a2ec-cf14-4e75-b41b-34ec37fbb855 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.213684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a2ec-cf14-4e75-b41b-34ec37fbb855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.216850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d931a7-f7d7-4253-aee4-d3a1709e1d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:29.217502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d931a7-f7d7-4253-aee4-d3a1709e1d3a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.217773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d931a7-f7d7-4253-aee4-d3a1709e1d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.218059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d931a7-f7d7-4253-aee4-d3a1709e1d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.218715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d931a7-f7d7-4253-aee4-d3a1709e1d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:29.220805 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d931a7-f7d7-4253-aee4-d3a1709e1d3a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:29.234609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 693/1370] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:29.235532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d931a7-f7d7-4253-aee4-d3a1709e1d3a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:29.246867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d931a7-f7d7-4253-aee4-d3a1709e1d3a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:29.251576 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ad426-ad06-4b83-a344-094cf3708ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:29.252192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ad426-ad06-4b83-a344-094cf3708ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.252472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ad426-ad06-4b83-a344-094cf3708ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.252746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ad426-ad06-4b83-a344-094cf3708ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.253381 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ad426-ad06-4b83-a344-094cf3708ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:29.255112 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ad426-ad06-4b83-a344-094cf3708ba2 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:29.267363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 694/1371] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:29.268665 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc01b3-daf1-4b34-acf3-c9d89aab0cc7 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.268951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc01b3-daf1-4b34-acf3-c9d89aab0cc7 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.269227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc01b3-daf1-4b34-acf3-c9d89aab0cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.277426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-7d75a2ec-cf14-4e75-b41b-34ec37fbb855 None None] MFA Rules not processed for user `b0ec118e7aee436da6098f5dda22ac0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:29.279016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-7d75a2ec-cf14-4e75-b41b-34ec37fbb855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:29.305903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-78fc01b3-daf1-4b34-acf3-c9d89aab0cc7 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:29.307221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-78fc01b3-daf1-4b34-acf3-c9d89aab0cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:29.331532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 695/1372] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:29.332386 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc01b3-daf1-4b34-acf3-c9d89aab0cc7 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:29.334898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:29.353374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc01b3-daf1-4b34-acf3-c9d89aab0cc7 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:29.367892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b664-8ec7-4f14-8fe9-64110bcf27bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:29.368592 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b664-8ec7-4f14-8fe9-64110bcf27bc admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.368874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b664-8ec7-4f14-8fe9-64110bcf27bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.369201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b664-8ec7-4f14-8fe9-64110bcf27bc admin admin] PATH_INFO: `/v3/projects/52fd14ce2ae348a3b9184832d69df0ae/users/b854171b69354c5a894e04f78f630eac/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.406028 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b664-8ec7-4f14-8fe9-64110bcf27bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fd14ce2ae348a3b9184832d69df0ae, user_id=b854171b69354c5a894e04f78f630eac, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:29.411722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b664-8ec7-4f14-8fe9-64110bcf27bc admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:29.435694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 678/1373] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:29.441026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a2ec-cf14-4e75-b41b-34ec37fbb855 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:29.472442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 696/1374] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:29 2022] PUT /identity/v3/projects/52fd14ce2ae348a3b9184832d69df0ae/users/b854171b69354c5a894e04f78f630eac/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:29.473770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a2ec-cf14-4e75-b41b-34ec37fbb855 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:29.477853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b664-8ec7-4f14-8fe9-64110bcf27bc admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:29.598863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc2b47-1048-407f-9ac0-aacaa140e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:29.599773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc2b47-1048-407f-9ac0-aacaa140e641 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.600213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc2b47-1048-407f-9ac0-aacaa140e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.600641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc2b47-1048-407f-9ac0-aacaa140e641 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.601438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc2b47-1048-407f-9ac0-aacaa140e641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:29.608210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc2b47-1048-407f-9ac0-aacaa140e641 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:29.628669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 679/1375] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:29.629951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc2b47-1048-407f-9ac0-aacaa140e641 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:29.637959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dfdc2b47-1048-407f-9ac0-aacaa140e641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:29.662966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b664-8ec7-4f14-8fe9-64110bcf27bc admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:29.687129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1865a8-f603-4949-9f2b-92e3b07c9ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:29.687854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1865a8-f603-4949-9f2b-92e3b07c9ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.688167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1865a8-f603-4949-9f2b-92e3b07c9ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.688529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1865a8-f603-4949-9f2b-92e3b07c9ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.693923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1865a8-f603-4949-9f2b-92e3b07c9ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:29.694319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1865a8-f603-4949-9f2b-92e3b07c9ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:29.696118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1865a8-f603-4949-9f2b-92e3b07c9ca7 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:29.729600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 697/1376] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:29.735685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18264-7a49-431b-8bb7-ecfdb75c2e4a None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.736011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18264-7a49-431b-8bb7-ecfdb75c2e4a None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.736247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18264-7a49-431b-8bb7-ecfdb75c2e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.774201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc2b47-1048-407f-9ac0-aacaa140e641 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:29.785849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6da5d-9f67-4b5d-a6c9-b8bb2021e0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:29.786897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6da5d-9f67-4b5d-a6c9-b8bb2021e0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:29.787468 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6da5d-9f67-4b5d-a6c9-b8bb2021e0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:29.788133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6da5d-9f67-4b5d-a6c9-b8bb2021e0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:29.807565 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-e9a18264-7a49-431b-8bb7-ecfdb75c2e4a None None] MFA Rules not processed for user `b854171b69354c5a894e04f78f630eac`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:29.811002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e9a18264-7a49-431b-8bb7-ecfdb75c2e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:29.951629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6da5d-9f67-4b5d-a6c9-b8bb2021e0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:29.953513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6da5d-9f67-4b5d-a6c9-b8bb2021e0d3 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:29.957695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:29.983471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 680/1377] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:29.984677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6da5d-9f67-4b5d-a6c9-b8bb2021e0d3 service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:29.996923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6da5d-9f67-4b5d-a6c9-b8bb2021e0d3 service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:30.003976 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724e8b1-b599-422d-840d-44c3d73fc329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:30.005203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724e8b1-b599-422d-840d-44c3d73fc329 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:30.005720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724e8b1-b599-422d-840d-44c3d73fc329 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:30.006228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724e8b1-b599-422d-840d-44c3d73fc329 admin admin] PATH_INFO: `/v3/projects/874995e5a6cb49a7b32de86822135517/users/51c6b86a43bd435ea1dbefd42533d5d3/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:30.009128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:30.029282 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 698/1378] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:30.031431 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a18264-7a49-431b-8bb7-ecfdb75c2e4a None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:30.064377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a18264-7a49-431b-8bb7-ecfdb75c2e4a None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:30.069692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724e8b1-b599-422d-840d-44c3d73fc329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874995e5a6cb49a7b32de86822135517, user_id=51c6b86a43bd435ea1dbefd42533d5d3, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:30.078414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f0b8b-feab-48f8-8972-9d27e2b22e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:30.080500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0b8b-feab-48f8-8972-9d27e2b22e92 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:30.080788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0b8b-feab-48f8-8972-9d27e2b22e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:30.081059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0b8b-feab-48f8-8972-9d27e2b22e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:30.083511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724e8b1-b599-422d-840d-44c3d73fc329 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:30.083672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f0b8b-feab-48f8-8972-9d27e2b22e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:30.090162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f0b8b-feab-48f8-8972-9d27e2b22e92 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:30.126897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 681/1379] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:29 2022] PUT /identity/v3/projects/874995e5a6cb49a7b32de86822135517/users/51c6b86a43bd435ea1dbefd42533d5d3/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:30.128735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724e8b1-b599-422d-840d-44c3d73fc329 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:30.187727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 699/1380] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:30 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:30.187727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bd439-022e-4edc-a1fb-a62522c46aae None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:30.187727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bd439-022e-4edc-a1fb-a62522c46aae None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:30.188184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bd439-022e-4edc-a1fb-a62522c46aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:30.261067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-0a3bd439-022e-4edc-a1fb-a62522c46aae None None] MFA Rules not processed for user `51c6b86a43bd435ea1dbefd42533d5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:30.266314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0a3bd439-022e-4edc-a1fb-a62522c46aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:30.410610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 700/1381] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:30.414517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bd439-022e-4edc-a1fb-a62522c46aae None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:30.463936 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724e8b1-b599-422d-840d-44c3d73fc329 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:30.598840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bd439-022e-4edc-a1fb-a62522c46aae None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:30.612847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364068f9-fd0e-4d8c-8080-476099524ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:30.617937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364068f9-fd0e-4d8c-8080-476099524ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:30.618226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364068f9-fd0e-4d8c-8080-476099524ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:30.620382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364068f9-fd0e-4d8c-8080-476099524ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:30.621253 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364068f9-fd0e-4d8c-8080-476099524ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:30.631966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364068f9-fd0e-4d8c-8080-476099524ea3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:30.665331 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c546048-6d62-424e-9ea2-92f254ab66e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:30.667573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c546048-6d62-424e-9ea2-92f254ab66e7 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:30.668201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c546048-6d62-424e-9ea2-92f254ab66e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:30.668627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c546048-6d62-424e-9ea2-92f254ab66e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:30.669539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c546048-6d62-424e-9ea2-92f254ab66e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:30.697069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c546048-6d62-424e-9ea2-92f254ab66e7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:30.703555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 701/1382] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:30 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:30.709757 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da268b-1bef-4477-bc58-b5da0833130e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:30.710041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da268b-1bef-4477-bc58-b5da0833130e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:30.714494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da268b-1bef-4477-bc58-b5da0833130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:30.777748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 682/1383] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:30 2022] POST /identity/v3/projects => generated 377 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:30.778989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c546048-6d62-424e-9ea2-92f254ab66e7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:30.794453 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-05da268b-1bef-4477-bc58-b5da0833130e None None] MFA Rules not processed for user `beff795898ae42ae8ca96c3ccc00a31f`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:30.798141 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-05da268b-1bef-4477-bc58-b5da0833130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:30.903040 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:31.016569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c546048-6d62-424e-9ea2-92f254ab66e7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:31.045324 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f2bd0-cba4-41b0-9431-0dc2adc63209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:31.045959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f2bd0-cba4-41b0-9431-0dc2adc63209 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:31.046254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f2bd0-cba4-41b0-9431-0dc2adc63209 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:31.046507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f2bd0-cba4-41b0-9431-0dc2adc63209 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:31.049436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f2bd0-cba4-41b0-9431-0dc2adc63209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:31.055626 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f2bd0-cba4-41b0-9431-0dc2adc63209 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:31.073879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 702/1384] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:31.075407 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da268b-1bef-4477-bc58-b5da0833130e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:31.113399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da268b-1bef-4477-bc58-b5da0833130e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:31.126957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:31.130776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0284473-f33a-4948-8226-3b57eeba4413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:31.140526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284473-f33a-4948-8226-3b57eeba4413 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:31.140708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 683/1385] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:30 2022] POST /identity/v3/projects => generated 363 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:31.140708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f2bd0-cba4-41b0-9431-0dc2adc63209 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:31.142308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284473-f33a-4948-8226-3b57eeba4413 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:31.143767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284473-f33a-4948-8226-3b57eeba4413 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:31.144680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0284473-f33a-4948-8226-3b57eeba4413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:31.148083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0284473-f33a-4948-8226-3b57eeba4413 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:31.190128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 703/1386] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:31.191112 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0284473-f33a-4948-8226-3b57eeba4413 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:31.205822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c0284473-f33a-4948-8226-3b57eeba4413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:31.273378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f2bd0-cba4-41b0-9431-0dc2adc63209 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:31.296337 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b8758-29f1-4deb-bb1b-67b25b7cb8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:31.298594 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b8758-29f1-4deb-bb1b-67b25b7cb8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:31.300332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b8758-29f1-4deb-bb1b-67b25b7cb8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:31.301031 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b8758-29f1-4deb-bb1b-67b25b7cb8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:31.302325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b8758-29f1-4deb-bb1b-67b25b7cb8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:31.306029 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b8758-29f1-4deb-bb1b-67b25b7cb8b6 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:31.346551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 684/1387] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:31 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:31.348814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b8758-29f1-4deb-bb1b-67b25b7cb8b6 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:31.373326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b8758-29f1-4deb-bb1b-67b25b7cb8b6 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:31.381475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e4055-77e8-40ec-8437-bf3d8b89e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:31.385703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4055-77e8-40ec-8437-bf3d8b89e9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:31.386059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4055-77e8-40ec-8437-bf3d8b89e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:31.386407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4055-77e8-40ec-8437-bf3d8b89e9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:31.390124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e4055-77e8-40ec-8437-bf3d8b89e9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:31.392991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e4055-77e8-40ec-8437-bf3d8b89e9a9 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:31.444784 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 685/1388] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:31 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:31.448187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e4055-77e8-40ec-8437-bf3d8b89e9a9 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:31.470395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0284473-f33a-4948-8226-3b57eeba4413 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:31.478385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e4055-77e8-40ec-8437-bf3d8b89e9a9 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:31.499295 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc938388-3791-4e51-a8de-bf07068f8351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:31.505633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938388-3791-4e51-a8de-bf07068f8351 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:31.506068 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938388-3791-4e51-a8de-bf07068f8351 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:31.506367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938388-3791-4e51-a8de-bf07068f8351 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:31.510923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc938388-3791-4e51-a8de-bf07068f8351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:31.523917 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc938388-3791-4e51-a8de-bf07068f8351 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:31.609800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 686/1389] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:31.611695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc938388-3791-4e51-a8de-bf07068f8351 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:31.643134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc938388-3791-4e51-a8de-bf07068f8351 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:31.655208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3167c7-50bb-4642-a53a-0d92089834fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:31.665088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3167c7-50bb-4642-a53a-0d92089834fc admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:31.665088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3167c7-50bb-4642-a53a-0d92089834fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:31.665088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3167c7-50bb-4642-a53a-0d92089834fc admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:31.665088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3167c7-50bb-4642-a53a-0d92089834fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:31.667346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3167c7-50bb-4642-a53a-0d92089834fc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:31.694362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 687/1390] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:31.702143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3167c7-50bb-4642-a53a-0d92089834fc admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:31.703123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35227d2b-b36f-4da4-8f39-cfe26399b804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:31.703939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35227d2b-b36f-4da4-8f39-cfe26399b804 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:31.704223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35227d2b-b36f-4da4-8f39-cfe26399b804 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:31.704503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35227d2b-b36f-4da4-8f39-cfe26399b804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:31.741967 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3167c7-50bb-4642-a53a-0d92089834fc admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:31.757999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853d3c-4471-4aca-a8b0-5fd7fa8c88b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:31.761383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853d3c-4471-4aca-a8b0-5fd7fa8c88b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:31.761722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853d3c-4471-4aca-a8b0-5fd7fa8c88b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:31.761998 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853d3c-4471-4aca-a8b0-5fd7fa8c88b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:31.764719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47853d3c-4471-4aca-a8b0-5fd7fa8c88b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:31.766403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47853d3c-4471-4aca-a8b0-5fd7fa8c88b6 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:31.859005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 688/1391] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:31.860190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853d3c-4471-4aca-a8b0-5fd7fa8c88b6 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:31.898587 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853d3c-4471-4aca-a8b0-5fd7fa8c88b6 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:31.907243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:31.936225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35227d2b-b36f-4da4-8f39-cfe26399b804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:31.937272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87a83a-0e42-4e16-b02f-b1ff712e50ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:31.939178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35227d2b-b36f-4da4-8f39-cfe26399b804 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:31.947378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a83a-0e42-4e16-b02f-b1ff712e50ce admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:31.947924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a83a-0e42-4e16-b02f-b1ff712e50ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:31.948276 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a83a-0e42-4e16-b02f-b1ff712e50ce admin admin] PATH_INFO: `/v3/projects/a953a6c99852491686d8df8a2d477cf9/users/9ea47dc166e84119abf1cda279cf006b/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:32.003809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 704/1392] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 813 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:32.004775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35227d2b-b36f-4da4-8f39-cfe26399b804 service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:32.019716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87a83a-0e42-4e16-b02f-b1ff712e50ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a953a6c99852491686d8df8a2d477cf9, user_id=9ea47dc166e84119abf1cda279cf006b, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:32.032980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87a83a-0e42-4e16-b02f-b1ff712e50ce admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:32.048786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35227d2b-b36f-4da4-8f39-cfe26399b804 service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:32.071870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 689/1393] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:31 2022] PUT /identity/v3/projects/a953a6c99852491686d8df8a2d477cf9/users/9ea47dc166e84119abf1cda279cf006b/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:32.076412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87a83a-0e42-4e16-b02f-b1ff712e50ce admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:32.092644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b443a1-59cf-4013-8f24-6fe059caa863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:32.093352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b443a1-59cf-4013-8f24-6fe059caa863 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:32.096972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b443a1-59cf-4013-8f24-6fe059caa863 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:32.097307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b443a1-59cf-4013-8f24-6fe059caa863 admin admin] PATH_INFO: `/v3/projects/cd8f6522d5ee4866b7b53bce3cab9254/users/724bf2608ed541ffb908ee7fc8d6d879/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:32.155893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b443a1-59cf-4013-8f24-6fe059caa863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8f6522d5ee4866b7b53bce3cab9254, user_id=724bf2608ed541ffb908ee7fc8d6d879, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:32.160400 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b443a1-59cf-4013-8f24-6fe059caa863 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:32.209815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 705/1394] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:32 2022] PUT /identity/v3/projects/cd8f6522d5ee4866b7b53bce3cab9254/users/724bf2608ed541ffb908ee7fc8d6d879/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:32.212402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad6fb-62b8-4fa4-9300-fe762c626c33 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:32.213182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad6fb-62b8-4fa4-9300-fe762c626c33 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:32.215085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad6fb-62b8-4fa4-9300-fe762c626c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:32.305487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87a83a-0e42-4e16-b02f-b1ff712e50ce admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:32.369740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:32.372557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d71ad6fb-62b8-4fa4-9300-fe762c626c33 None None] MFA Rules not processed for user `9ea47dc166e84119abf1cda279cf006b`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:32.374468 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d71ad6fb-62b8-4fa4-9300-fe762c626c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:32.504944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74b8ff-9693-4120-b699-590ef14da2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:32.509197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b8ff-9693-4120-b699-590ef14da2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:32.509486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b8ff-9693-4120-b699-590ef14da2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:32.509835 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b8ff-9693-4120-b699-590ef14da2ef admin admin] PATH_INFO: `/v3/projects/f61501d8be4b482aa8016581e1637bd9/users/54de8377f0f944579ab96b223bf2cb71/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:32.564101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 706/1395] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:32.571239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ad6fb-62b8-4fa4-9300-fe762c626c33 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:32.572043 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74b8ff-9693-4120-b699-590ef14da2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61501d8be4b482aa8016581e1637bd9, user_id=54de8377f0f944579ab96b223bf2cb71, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:32.587677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74b8ff-9693-4120-b699-590ef14da2ef admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:32.622941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ad6fb-62b8-4fa4-9300-fe762c626c33 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:32.634714 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 690/1396] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:32 2022] PUT /identity/v3/projects/f61501d8be4b482aa8016581e1637bd9/users/54de8377f0f944579ab96b223bf2cb71/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:32.653539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74b8ff-9693-4120-b699-590ef14da2ef admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:32.832417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1bdc4-59c8-4db8-ab2f-c6c2c0a56687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:32.833652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1bdc4-59c8-4db8-ab2f-c6c2c0a56687 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:32.834079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1bdc4-59c8-4db8-ab2f-c6c2c0a56687 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:32.834489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1bdc4-59c8-4db8-ab2f-c6c2c0a56687 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:32.835342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1bdc4-59c8-4db8-ab2f-c6c2c0a56687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:32.837197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1bdc4-59c8-4db8-ab2f-c6c2c0a56687 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:32.874754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 707/1397] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:32.875943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1bdc4-59c8-4db8-ab2f-c6c2c0a56687 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:32.909014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74b8ff-9693-4120-b699-590ef14da2ef admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:32.921613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811ae95-2ec1-44ee-9f17-b46d31878bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:32.922447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811ae95-2ec1-44ee-9f17-b46d31878bdb admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:32.922989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811ae95-2ec1-44ee-9f17-b46d31878bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:32.923470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811ae95-2ec1-44ee-9f17-b46d31878bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:32.924838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811ae95-2ec1-44ee-9f17-b46d31878bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:32.926977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811ae95-2ec1-44ee-9f17-b46d31878bdb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:32.932243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1bdc4-59c8-4db8-ab2f-c6c2c0a56687 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:32.965610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac9e57-0067-49c8-851a-00f2691a12d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:32.966955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac9e57-0067-49c8-851a-00f2691a12d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:32.967527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac9e57-0067-49c8-851a-00f2691a12d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:32.968041 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac9e57-0067-49c8-851a-00f2691a12d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:32.968915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac9e57-0067-49c8-851a-00f2691a12d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:32.970796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac9e57-0067-49c8-851a-00f2691a12d3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:32.988986 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 708/1398] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:32.990142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac9e57-0067-49c8-851a-00f2691a12d3 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:33.022821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac9e57-0067-49c8-851a-00f2691a12d3 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:33.027819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 691/1399] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:32 2022] POST /identity/v3/projects => generated 365 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:33.027819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811ae95-2ec1-44ee-9f17-b46d31878bdb admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:33.185564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:33.254058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6510ce-214d-4cbe-8f19-05511c8a309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:33.256612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6510ce-214d-4cbe-8f19-05511c8a309b admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:33.259514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6510ce-214d-4cbe-8f19-05511c8a309b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:33.260968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6510ce-214d-4cbe-8f19-05511c8a309b admin admin] PATH_INFO: `/v3/projects/cd8f6522d5ee4866b7b53bce3cab9254/users/724bf2608ed541ffb908ee7fc8d6d879/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:33.268422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6510ce-214d-4cbe-8f19-05511c8a309b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8f6522d5ee4866b7b53bce3cab9254, user_id=724bf2608ed541ffb908ee7fc8d6d879, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:33.279083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6510ce-214d-4cbe-8f19-05511c8a309b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:33.317770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811ae95-2ec1-44ee-9f17-b46d31878bdb admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:33.345927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 709/1400] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:32 2022] PUT /identity/v3/projects/cd8f6522d5ee4866b7b53bce3cab9254/users/724bf2608ed541ffb908ee7fc8d6d879/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:33.365801 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6510ce-214d-4cbe-8f19-05511c8a309b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:33.529542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6510ce-214d-4cbe-8f19-05511c8a309b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:33.530055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:33.542193 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b16bb-dad1-4c23-8379-8301b9d1f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:33.545848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b16bb-dad1-4c23-8379-8301b9d1f3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:33.548031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b16bb-dad1-4c23-8379-8301b9d1f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:33.548466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b16bb-dad1-4c23-8379-8301b9d1f3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:33.550172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b16bb-dad1-4c23-8379-8301b9d1f3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:33.561756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b16bb-dad1-4c23-8379-8301b9d1f3b6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:33.628814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dabc3-1e76-4be3-be86-82d79d33d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:33.629385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 710/1401] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:33 2022] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:33.633097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dabc3-1e76-4be3-be86-82d79d33d822 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:33.633399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dabc3-1e76-4be3-be86-82d79d33d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:33.633684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dabc3-1e76-4be3-be86-82d79d33d822 admin admin] PATH_INFO: `/v3/projects/f61501d8be4b482aa8016581e1637bd9/users/54de8377f0f944579ab96b223bf2cb71/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:33.634072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b699-1f56-43bd-837b-741caacee5ce None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:33.634431 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b699-1f56-43bd-837b-741caacee5ce None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:33.635186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b699-1f56-43bd-837b-741caacee5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:33.639617 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dabc3-1e76-4be3-be86-82d79d33d822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61501d8be4b482aa8016581e1637bd9, user_id=54de8377f0f944579ab96b223bf2cb71, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:33.648613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dabc3-1e76-4be3-be86-82d79d33d822 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:33.685831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 692/1402] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:33 2022] PUT /identity/v3/projects/f61501d8be4b482aa8016581e1637bd9/users/54de8377f0f944579ab96b223bf2cb71/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:33.687764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dabc3-1e76-4be3-be86-82d79d33d822 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:33.719072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d195b699-1f56-43bd-837b-741caacee5ce None None] MFA Rules not processed for user `724bf2608ed541ffb908ee7fc8d6d879`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:33.720662 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d195b699-1f56-43bd-837b-741caacee5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:33.852321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 711/1403] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:33.857932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b699-1f56-43bd-837b-741caacee5ce None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:33.858354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dabc3-1e76-4be3-be86-82d79d33d822 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:33.870990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:33.872755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:33.873127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:33.873566 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] PATH_INFO: `/v3/users/fe079a88ac224ad5a3ba45dde745517c` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:33.875902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b699-1f56-43bd-837b-741caacee5ce None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:33.876873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe079a88ac224ad5a3ba45dde745517c)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:33.881753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a837ed-514a-413b-be0e-fd9cd5ff783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:33.882506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a837ed-514a-413b-be0e-fd9cd5ff783b admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:33.882857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a837ed-514a-413b-be0e-fd9cd5ff783b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:33.883239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a837ed-514a-413b-be0e-fd9cd5ff783b admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:33.883982 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a837ed-514a-413b-be0e-fd9cd5ff783b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:33.884293 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:33.886405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a837ed-514a-413b-be0e-fd9cd5ff783b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:33.905950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 712/1404] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:33.907816 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838652-6f65-4a3b-a9d8-4bb88dc69c0f None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:33.908357 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838652-6f65-4a3b-a9d8-4bb88dc69c0f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:33.908746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0838652-6f65-4a3b-a9d8-4bb88dc69c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:33.948460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d0838652-6f65-4a3b-a9d8-4bb88dc69c0f None None] MFA Rules not processed for user `54de8377f0f944579ab96b223bf2cb71`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:33.959876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d0838652-6f65-4a3b-a9d8-4bb88dc69c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:33.999140 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe079a88ac224ad5a3ba45dde745517c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:34.016700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe079a88ac224ad5a3ba45dde745517c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:34.017528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe079a88ac224ad5a3ba45dde745517c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:34.018231 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe079a88ac224ad5a3ba45dde745517c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:34.033937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe079a88ac224ad5a3ba45dde745517c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:34.036098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:34.075939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 693/1405] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:33 2022] DELETE /identity/v3/users/fe079a88ac224ad5a3ba45dde745517c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:34.077387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:34.079010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:34.114312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 713/1406] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:34.115437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0838652-6f65-4a3b-a9d8-4bb88dc69c0f None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:34.117157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d0838652-6f65-4a3b-a9d8-4bb88dc69c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:34.138064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0838652-6f65-4a3b-a9d8-4bb88dc69c0f None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:34.218310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dc3f0-2a69-46fd-bf4d-72c8227c5528 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:34.227218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2cf4d-48c6-439a-9bbe-d873902f2e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:34.228773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2cf4d-48c6-439a-9bbe-d873902f2e92 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:34.229113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2cf4d-48c6-439a-9bbe-d873902f2e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:34.229391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2cf4d-48c6-439a-9bbe-d873902f2e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:34.235688 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a6a2cf4d-48c6-439a-9bbe-d873902f2e92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:34.246287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:34.261204 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09638e5a-334c-47a2-9521-c45720c7e6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:34.262744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09638e5a-334c-47a2-9521-c45720c7e6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:34.263191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09638e5a-334c-47a2-9521-c45720c7e6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:34.263708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09638e5a-334c-47a2-9521-c45720c7e6b7 admin admin] PATH_INFO: `/v3/projects/9ef5e93c49df4e5bb56c96ae333c814a/users/777c7ee9531d47218cb05181b042ab5b/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:34.295596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09638e5a-334c-47a2-9521-c45720c7e6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef5e93c49df4e5bb56c96ae333c814a, user_id=777c7ee9531d47218cb05181b042ab5b, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:34.306470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09638e5a-334c-47a2-9521-c45720c7e6b7 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:34.327580 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 714/1407] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:34 2022] PUT /identity/v3/projects/9ef5e93c49df4e5bb56c96ae333c814a/users/777c7ee9531d47218cb05181b042ab5b/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:34.329017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ac0fc-1371-4ede-9763-7f96ca7ef132 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:34.329303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ac0fc-1371-4ede-9763-7f96ca7ef132 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:34.329578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ac0fc-1371-4ede-9763-7f96ca7ef132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:34.363163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-544ac0fc-1371-4ede-9763-7f96ca7ef132 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:34.366110 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-544ac0fc-1371-4ede-9763-7f96ca7ef132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:34.374597 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2cf4d-48c6-439a-9bbe-d873902f2e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:34.376293 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2cf4d-48c6-439a-9bbe-d873902f2e92 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:34.389386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 694/1408] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:34.390977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2cf4d-48c6-439a-9bbe-d873902f2e92 service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:34.394734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a6a2cf4d-48c6-439a-9bbe-d873902f2e92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:34.419829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2cf4d-48c6-439a-9bbe-d873902f2e92 service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:34.494554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 715/1409] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:34.497398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b144e-80ae-43cf-b1fc-6764e5145393 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:34.497698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b144e-80ae-43cf-b1fc-6764e5145393 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:34.497981 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b144e-80ae-43cf-b1fc-6764e5145393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:34.533984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6cdd-9871-4d5f-b981-f01559dcbc28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:34.534637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6cdd-9871-4d5f-b981-f01559dcbc28 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:34.534927 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6cdd-9871-4d5f-b981-f01559dcbc28 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:34.535209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6cdd-9871-4d5f-b981-f01559dcbc28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:34.598752 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-679b144e-80ae-43cf-b1fc-6764e5145393 None None] MFA Rules not processed for user `94fe5ae1c52648fc9507216f4ab8d240`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:34.600242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-679b144e-80ae-43cf-b1fc-6764e5145393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:34.746314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a6cdd-9871-4d5f-b981-f01559dcbc28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:34.749761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a6cdd-9871-4d5f-b981-f01559dcbc28 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:34.750316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:34.800925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 716/1410] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:34.800925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea888a-4161-4afb-89de-a61b53fe6ae8 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:34.800925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea888a-4161-4afb-89de-a61b53fe6ae8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:34.800925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea888a-4161-4afb-89de-a61b53fe6ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:34.807539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 695/1411] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:34.811083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6cdd-9871-4d5f-b981-f01559dcbc28 service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:34.822515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c9ea888a-4161-4afb-89de-a61b53fe6ae8 None None] MFA Rules not processed for user `b3afb5c7305d4162b32e57385d949af6`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:34.823863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c9ea888a-4161-4afb-89de-a61b53fe6ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:34.867940 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6cdd-9871-4d5f-b981-f01559dcbc28 service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:34.887964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb07546-d736-458b-af77-4c1746309431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:34.889083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb07546-d736-458b-af77-4c1746309431 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:34.889559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb07546-d736-458b-af77-4c1746309431 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:34.890026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb07546-d736-458b-af77-4c1746309431 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:34.891366 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb07546-d736-458b-af77-4c1746309431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:34.893637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb07546-d736-458b-af77-4c1746309431 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:34.927963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 696/1412] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:34.929635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb07546-d736-458b-af77-4c1746309431 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:34.945859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 717/1413] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:34.947499 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911e7fb-4753-4c66-bc5d-1b6340917c17 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:34.947836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911e7fb-4753-4c66-bc5d-1b6340917c17 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:34.947956 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-efb07546-d736-458b-af77-4c1746309431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:34.948118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911e7fb-4753-4c66-bc5d-1b6340917c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:34.996351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-3911e7fb-4753-4c66-bc5d-1b6340917c17 None None] MFA Rules not processed for user `94fe5ae1c52648fc9507216f4ab8d240`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:35.004286 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3911e7fb-4753-4c66-bc5d-1b6340917c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:35.099617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 718/1414] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:35.099617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066ad0-2407-429a-83c2-f077d7060dee None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:35.099617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066ad0-2407-429a-83c2-f077d7060dee None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:35.099617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066ad0-2407-429a-83c2-f077d7060dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:35.112667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:35.157967 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb07546-d736-458b-af77-4c1746309431 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:35.206893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f444c-b9e3-47fe-bf41-2c879321f211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:35.207632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f444c-b9e3-47fe-bf41-2c879321f211 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:35.208270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f444c-b9e3-47fe-bf41-2c879321f211 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:35.208447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f444c-b9e3-47fe-bf41-2c879321f211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:35.232194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f444c-b9e3-47fe-bf41-2c879321f211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:35.234001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f444c-b9e3-47fe-bf41-2c879321f211 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:35.251437 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 697/1415] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:35.252631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f444c-b9e3-47fe-bf41-2c879321f211 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:35.279553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f444c-b9e3-47fe-bf41-2c879321f211 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:35.288556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-cb066ad0-2407-429a-83c2-f077d7060dee None None] MFA Rules not processed for user `65d7e0e126ba4259b39283ab582a3345`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:35.290652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cb066ad0-2407-429a-83c2-f077d7060dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:35.296406 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080beb9-3ecb-48fc-9eb5-c7b0dd7b27aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:35.302091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080beb9-3ecb-48fc-9eb5-c7b0dd7b27aa admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:35.302396 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080beb9-3ecb-48fc-9eb5-c7b0dd7b27aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:35.302684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080beb9-3ecb-48fc-9eb5-c7b0dd7b27aa admin admin] PATH_INFO: `/v3/projects/9ef5e93c49df4e5bb56c96ae333c814a/users/777c7ee9531d47218cb05181b042ab5b/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:35.311227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080beb9-3ecb-48fc-9eb5-c7b0dd7b27aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef5e93c49df4e5bb56c96ae333c814a, user_id=777c7ee9531d47218cb05181b042ab5b, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:35.321460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080beb9-3ecb-48fc-9eb5-c7b0dd7b27aa admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:35.381080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 698/1416] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:35 2022] PUT /identity/v3/projects/9ef5e93c49df4e5bb56c96ae333c814a/users/777c7ee9531d47218cb05181b042ab5b/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:35.386065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080beb9-3ecb-48fc-9eb5-c7b0dd7b27aa admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:35.510670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 719/1417] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:35.513316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb066ad0-2407-429a-83c2-f077d7060dee None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:35.516786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cb066ad0-2407-429a-83c2-f077d7060dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:35.558219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080beb9-3ecb-48fc-9eb5-c7b0dd7b27aa admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:35.562263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452852-cba6-4b3d-ae39-0e120165ae7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:35.562805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452852-cba6-4b3d-ae39-0e120165ae7a service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:35.563198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452852-cba6-4b3d-ae39-0e120165ae7a service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:35.563601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452852-cba6-4b3d-ae39-0e120165ae7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:35.565500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-7b452852-cba6-4b3d-ae39-0e120165ae7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:35.727024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452852-cba6-4b3d-ae39-0e120165ae7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:35.729135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452852-cba6-4b3d-ae39-0e120165ae7a service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:35.737279 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb066ad0-2407-429a-83c2-f077d7060dee None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:35.745681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:35.753761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 699/1418] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:35.758517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b5ef4-35c5-4c4a-a1dd-81a1cf21746f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:35.759316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b5ef4-35c5-4c4a-a1dd-81a1cf21746f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:35.759316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b5ef4-35c5-4c4a-a1dd-81a1cf21746f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:35.835254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-8d8b5ef4-35c5-4c4a-a1dd-81a1cf21746f None None] MFA Rules not processed for user `777c7ee9531d47218cb05181b042ab5b`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:35.836707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8d8b5ef4-35c5-4c4a-a1dd-81a1cf21746f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:35.892776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1d694-b06c-4396-9cd3-fbaeaaa134cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:35.894075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1d694-b06c-4396-9cd3-fbaeaaa134cf service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:35.894845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1d694-b06c-4396-9cd3-fbaeaaa134cf service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:35.895325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1d694-b06c-4396-9cd3-fbaeaaa134cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:36.009528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1d694-b06c-4396-9cd3-fbaeaaa134cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:36.011154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1d694-b06c-4396-9cd3-fbaeaaa134cf service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:36.023411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 700/1419] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:36.024818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729178e1-56e4-49f0-bb56-1e8d085e6bfd None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:36.025612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729178e1-56e4-49f0-bb56-1e8d085e6bfd None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:36.025912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729178e1-56e4-49f0-bb56-1e8d085e6bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:36.037727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 720/1420] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:36.039394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b18f3b-d718-4d00-85c3-ff360019ab39 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:36.039688 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b18f3b-d718-4d00-85c3-ff360019ab39 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:36.039973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b18f3b-d718-4d00-85c3-ff360019ab39 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:36.041886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 721/1421] 10.222.0.18 () {54 vars in 912 bytes} [Wed Oct 12 04:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:49:36.047415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-729178e1-56e4-49f0-bb56-1e8d085e6bfd None None] MFA Rules not processed for user `65d7e0e126ba4259b39283ab582a3345`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:36.049242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-729178e1-56e4-49f0-bb56-1e8d085e6bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:36.053930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6ee0-054b-4f8f-b3c5-93b6d08adf20 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:36.054214 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6ee0-054b-4f8f-b3c5-93b6d08adf20 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:36.055659 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6ee0-054b-4f8f-b3c5-93b6d08adf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:36.065264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:36.121940 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d15f6ee0-054b-4f8f-b3c5-93b6d08adf20 None None] MFA Rules not processed for user `dc59d3cc1fbc4d4382bffd8ae93075e1`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:36.123474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d15f6ee0-054b-4f8f-b3c5-93b6d08adf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:36.261407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 701/1422] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:36.263797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729178e1-56e4-49f0-bb56-1e8d085e6bfd None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:36.291165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729178e1-56e4-49f0-bb56-1e8d085e6bfd None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:36.299989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af31c56-9264-41c1-9ad4-e8d696678caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:36.300623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af31c56-9264-41c1-9ad4-e8d696678caa service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:36.300902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af31c56-9264-41c1-9ad4-e8d696678caa service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:36.301175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af31c56-9264-41c1-9ad4-e8d696678caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:36.349573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 722/1423] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:49:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:36.350350 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f6ee0-054b-4f8f-b3c5-93b6d08adf20 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:36.351793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d15f6ee0-054b-4f8f-b3c5-93b6d08adf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:36.360277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af31c56-9264-41c1-9ad4-e8d696678caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:36.366743 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af31c56-9264-41c1-9ad4-e8d696678caa service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:36.403735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 702/1424] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:36.448833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:36.538786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f6ee0-054b-4f8f-b3c5-93b6d08adf20 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:36.560174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:36.561040 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:36.563117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:36.563767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] PATH_INFO: `/v3/projects/3a2b6fb98b5e4723ab5c192693ff9d70` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:36.570398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2b6fb98b5e4723ab5c192693ff9d70)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:36.577455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:36.630854 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af31c56-9264-41c1-9ad4-e8d696678caa service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:36.641252 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af31c56-9264-41c1-9ad4-e8d696678caa service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:36.650693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedea54-4c3d-4b1e-9caf-0fa203404d0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:36.651551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedea54-4c3d-4b1e-9caf-0fa203404d0b service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:36.651662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedea54-4c3d-4b1e-9caf-0fa203404d0b service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:36.651930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedea54-4c3d-4b1e-9caf-0fa203404d0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:36.656814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0fedea54-4c3d-4b1e-9caf-0fa203404d0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:36.764080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2b6fb98b5e4723ab5c192693ff9d70', 'request_id': 'req-0620078c-3868-4298-846e-4859108a3474'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:36.782046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2b6fb98b5e4723ab5c192693ff9d70', 'request_id': 'req-0620078c-3868-4298-846e-4859108a3474'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:36.821868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2b6fb98b5e4723ab5c192693ff9d70', 'request_id': 'req-0620078c-3868-4298-846e-4859108a3474'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:36.856396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] The token cache is being invalidate because project 3a2b6fb98b5e4723ab5c192693ff9d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:36.857002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:36.858265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:36.860445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 723/1425] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:36 2022] DELETE /identity/v3/projects/3a2b6fb98b5e4723ab5c192693ff9d70 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:36.862080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:36.863693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:36.871154 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedea54-4c3d-4b1e-9caf-0fa203404d0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:36.875360 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedea54-4c3d-4b1e-9caf-0fa203404d0b service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:36.893917 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 703/1426] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:36.897486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b5a0-5bb2-4257-9fc6-510197de45c2 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:36.898094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b5a0-5bb2-4257-9fc6-510197de45c2 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:36.898389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b5a0-5bb2-4257-9fc6-510197de45c2 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:36.901936 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 704/1427] 10.222.0.18 () {54 vars in 912 bytes} [Wed Oct 12 04:49:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:49:36.902579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b5a0-5bb2-4257-9fc6-510197de45c2 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:36.905129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-68d4b5a0-5bb2-4257-9fc6-510197de45c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:36.967001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620078c-3868-4298-846e-4859108a3474 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:36.972577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f9596-3576-4a82-854c-529fe9f58c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:36.973703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f9596-3576-4a82-854c-529fe9f58c8c service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:36.974277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f9596-3576-4a82-854c-529fe9f58c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:36.974743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f9596-3576-4a82-854c-529fe9f58c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:36.977633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ff5f9596-3576-4a82-854c-529fe9f58c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:36.994622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f9596-3576-4a82-854c-529fe9f58c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:36.996864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f9596-3576-4a82-854c-529fe9f58c8c service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:37.007969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 724/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:37.010212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640017a-4742-4d91-9aca-43d0ea2b0db2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:37.010740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640017a-4742-4d91-9aca-43d0ea2b0db2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:37.011265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640017a-4742-4d91-9aca-43d0ea2b0db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:37.039826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-5640017a-4742-4d91-9aca-43d0ea2b0db2 None None] MFA Rules not processed for user `dc59d3cc1fbc4d4382bffd8ae93075e1`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:37.040015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b5a0-5bb2-4257-9fc6-510197de45c2 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:37.042248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5640017a-4742-4d91-9aca-43d0ea2b0db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:37.051070 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 725/1429] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:49:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:37.053831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:37.054626 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:37.055728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:37.056017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] PATH_INFO: `/v3/users/b0ec118e7aee436da6098f5dda22ac0d` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:37.060744 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ec118e7aee436da6098f5dda22ac0d)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:37.065373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:37.160461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f3d1d-3b84-4895-84ef-91279bd9de03 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:37.160989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f3d1d-3b84-4895-84ef-91279bd9de03 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:37.161417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f3d1d-3b84-4895-84ef-91279bd9de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:37.177723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:37.182479 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ec118e7aee436da6098f5dda22ac0d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:37.195101 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ec118e7aee436da6098f5dda22ac0d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:37.196945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ec118e7aee436da6098f5dda22ac0d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:37.197764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ec118e7aee436da6098f5dda22ac0d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:37.214422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ec118e7aee436da6098f5dda22ac0d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:37.247010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8e1f3d1d-3b84-4895-84ef-91279bd9de03 None None] MFA Rules not processed for user `beff795898ae42ae8ca96c3ccc00a31f`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:37.248875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8e1f3d1d-3b84-4895-84ef-91279bd9de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:37.255753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 705/1430] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:36 2022] DELETE /identity/v3/users/b0ec118e7aee436da6098f5dda22ac0d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:37.257688 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:37.261572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:37.432372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7d61d-5377-425e-a129-cc742adb5c12 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:37.444387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d1626-19c7-4ff3-a914-7f01072f1613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:37.445041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d1626-19c7-4ff3-a914-7f01072f1613 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:37.445327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d1626-19c7-4ff3-a914-7f01072f1613 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:37.445606 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d1626-19c7-4ff3-a914-7f01072f1613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:37.451391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9c0d1626-19c7-4ff3-a914-7f01072f1613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:37.480017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d1626-19c7-4ff3-a914-7f01072f1613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:37.481513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d1626-19c7-4ff3-a914-7f01072f1613 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:37.488364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 726/1431] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:49:37.510546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 706/1432] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:37.927662 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f3d1d-3b84-4895-84ef-91279bd9de03 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:37.929586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8e1f3d1d-3b84-4895-84ef-91279bd9de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:37.972993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:38.105512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f3d1d-3b84-4895-84ef-91279bd9de03 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:38.117502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f992d-0927-4f30-9031-a87aa9f07fbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:38.121195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f992d-0927-4f30-9031-a87aa9f07fbe service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:38.121477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f992d-0927-4f30-9031-a87aa9f07fbe service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:38.121755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f992d-0927-4f30-9031-a87aa9f07fbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:38.128356 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b15f992d-0927-4f30-9031-a87aa9f07fbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:38.297743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f992d-0927-4f30-9031-a87aa9f07fbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:38.300334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f992d-0927-4f30-9031-a87aa9f07fbe service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:38.310980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d1626-19c7-4ff3-a914-7f01072f1613 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:38.312586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9c0d1626-19c7-4ff3-a914-7f01072f1613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:38.342431 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 727/1433] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:38.381151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f992d-0927-4f30-9031-a87aa9f07fbe service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:38.382958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b15f992d-0927-4f30-9031-a87aa9f07fbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:38.483110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d1626-19c7-4ff3-a914-7f01072f1613 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:38.499087 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:38.500929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:38.502306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:38.503376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] PATH_INFO: `/v3/projects/ae6cab0873474afe82e2e81efb53b4b2` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:38.504233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6cab0873474afe82e2e81efb53b4b2)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:38.507637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:38.599140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f992d-0927-4f30-9031-a87aa9f07fbe service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:38.628002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6cab0873474afe82e2e81efb53b4b2', 'request_id': 'req-0ea15286-2ec0-45c1-9b49-7c8674fd3725'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:38.665423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6cab0873474afe82e2e81efb53b4b2', 'request_id': 'req-0ea15286-2ec0-45c1-9b49-7c8674fd3725'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:38.688982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6cab0873474afe82e2e81efb53b4b2', 'request_id': 'req-0ea15286-2ec0-45c1-9b49-7c8674fd3725'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:38.703892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:38.727472 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] The token cache is being invalidate because project ae6cab0873474afe82e2e81efb53b4b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:38.727792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:38.729776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:38.742583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 707/1434] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:38 2022] DELETE /identity/v3/projects/ae6cab0873474afe82e2e81efb53b4b2 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:38.742583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:38.742905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:38.803535 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:38.831998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916294c-c052-4f67-93cf-3b1ad3cb20c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:38.832862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916294c-c052-4f67-93cf-3b1ad3cb20c2 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:38.833572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916294c-c052-4f67-93cf-3b1ad3cb20c2 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:38.833922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916294c-c052-4f67-93cf-3b1ad3cb20c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:38.838731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b916294c-c052-4f67-93cf-3b1ad3cb20c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:39.005308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea15286-2ec0-45c1-9b49-7c8674fd3725 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:39.019310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d22b10-2c15-4957-80e3-4a3d9fc55493 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:39.020055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d22b10-2c15-4957-80e3-4a3d9fc55493 service placement] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:39.020418 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d22b10-2c15-4957-80e3-4a3d9fc55493 service placement] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:39.020782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d22b10-2c15-4957-80e3-4a3d9fc55493 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:39.030051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-99d22b10-2c15-4957-80e3-4a3d9fc55493 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:39.053722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916294c-c052-4f67-93cf-3b1ad3cb20c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:39.056582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916294c-c052-4f67-93cf-3b1ad3cb20c2 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:39.068819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d22b10-2c15-4957-80e3-4a3d9fc55493 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:39.070897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d22b10-2c15-4957-80e3-4a3d9fc55493 service placement] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:39.094625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 728/1436] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:39.094892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 708/1436] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:39.096520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e7b6-9143-4128-a9a4-23f5c072d334 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:39.096814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb41fa-f1b4-434d-afd3-c3b1a654a0c9 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:39.097430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e7b6-9143-4128-a9a4-23f5c072d334 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:39.097985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e7b6-9143-4128-a9a4-23f5c072d334 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:39.099465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb41fa-f1b4-434d-afd3-c3b1a654a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:39.099938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb41fa-f1b4-434d-afd3-c3b1a654a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:39.100213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 729/1437] 10.222.0.18 () {54 vars in 961 bytes} [Wed Oct 12 04:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:49:39.120743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054b976-8814-4b20-9ec0-9a1304ccac6b None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:39.121480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054b976-8814-4b20-9ec0-9a1304ccac6b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:39.122333 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054b976-8814-4b20-9ec0-9a1304ccac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:39.170249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-a4cb41fa-f1b4-434d-afd3-c3b1a654a0c9 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:39.171720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a4cb41fa-f1b4-434d-afd3-c3b1a654a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:39.181252 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c054b976-8814-4b20-9ec0-9a1304ccac6b None None] MFA Rules not processed for user `332a44161d204223983ed2aa3aef9317`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:39.182530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c054b976-8814-4b20-9ec0-9a1304ccac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:39.227026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 730/1438] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Oct 12 04:49:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:39.241516 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054b976-8814-4b20-9ec0-9a1304ccac6b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:39.294829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054b976-8814-4b20-9ec0-9a1304ccac6b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:39.332436 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca9747-c645-4f47-85cd-b9d7b3ae8f10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:39.333363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca9747-c645-4f47-85cd-b9d7b3ae8f10 service placement] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:39.333648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca9747-c645-4f47-85cd-b9d7b3ae8f10 service placement] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:39.346139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca9747-c645-4f47-85cd-b9d7b3ae8f10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:39.374959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 709/1439] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:39.383238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2fb3c-5373-4cb5-b795-c2be3d34506f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:39.383593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2fb3c-5373-4cb5-b795-c2be3d34506f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:39.383895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2fb3c-5373-4cb5-b795-c2be3d34506f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:39.401390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca9747-c645-4f47-85cd-b9d7b3ae8f10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:39.405976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca9747-c645-4f47-85cd-b9d7b3ae8f10 service placement] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:39.463629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-8aa2fb3c-5373-4cb5-b795-c2be3d34506f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:39.465375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8aa2fb3c-5373-4cb5-b795-c2be3d34506f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:39.484179 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 710/1440] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:39.489357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2fb3c-5373-4cb5-b795-c2be3d34506f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:39.489603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 731/1441] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:39.516900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2fb3c-5373-4cb5-b795-c2be3d34506f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:39.531628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001753-ceb8-4d6b-83d2-92f4a0576eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:39.532312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001753-ceb8-4d6b-83d2-92f4a0576eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:39.532595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001753-ceb8-4d6b-83d2-92f4a0576eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:39.534069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001753-ceb8-4d6b-83d2-92f4a0576eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:39.534765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2001753-ceb8-4d6b-83d2-92f4a0576eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:39.536308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2001753-ceb8-4d6b-83d2-92f4a0576eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:39.539797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2001753-ceb8-4d6b-83d2-92f4a0576eb5 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:39.579681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 711/1442] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:39.584892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca9747-c645-4f47-85cd-b9d7b3ae8f10 service placement] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:39.606996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca9747-c645-4f47-85cd-b9d7b3ae8f10 service placement] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:39.635123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03575365-7603-406d-aaa8-ea59e4e2529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:39.638302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575365-7603-406d-aaa8-ea59e4e2529f admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:39.640258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575365-7603-406d-aaa8-ea59e4e2529f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:39.640725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575365-7603-406d-aaa8-ea59e4e2529f admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:39.644519 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03575365-7603-406d-aaa8-ea59e4e2529f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:39.648773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03575365-7603-406d-aaa8-ea59e4e2529f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:39.717909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 732/1443] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:39 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:39.721176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001753-ceb8-4d6b-83d2-92f4a0576eb5 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:39.754040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001753-ceb8-4d6b-83d2-92f4a0576eb5 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:39.982048 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d7e82-2d35-402a-b4ab-c3cb79bf09f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:39.982920 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d7e82-2d35-402a-b4ab-c3cb79bf09f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:39.986845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d7e82-2d35-402a-b4ab-c3cb79bf09f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:39.996556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d7e82-2d35-402a-b4ab-c3cb79bf09f6 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:39.997388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d7e82-2d35-402a-b4ab-c3cb79bf09f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:39.999618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d7e82-2d35-402a-b4ab-c3cb79bf09f6 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:40.059609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:40.098080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 712/1444] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:39 2022] POST /identity/v3/users => generated 294 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:40.099195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03575365-7603-406d-aaa8-ea59e4e2529f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:40.120965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03575365-7603-406d-aaa8-ea59e4e2529f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:40.138424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820013bd-526a-45c5-b946-bab2376515a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:40.139094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820013bd-526a-45c5-b946-bab2376515a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:40.140862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820013bd-526a-45c5-b946-bab2376515a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:40.140862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820013bd-526a-45c5-b946-bab2376515a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:40.140862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820013bd-526a-45c5-b946-bab2376515a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:40.142064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820013bd-526a-45c5-b946-bab2376515a2 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:40.213353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d7e82-2d35-402a-b4ab-c3cb79bf09f6 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:40.215676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 733/1445] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:40.254538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d7e82-2d35-402a-b4ab-c3cb79bf09f6 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:40.293033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f87ed6-a419-49d7-80cf-bf2df1b01c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:40.300085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f87ed6-a419-49d7-80cf-bf2df1b01c9c admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:40.301937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f87ed6-a419-49d7-80cf-bf2df1b01c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:40.303255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f87ed6-a419-49d7-80cf-bf2df1b01c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:40.311799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f87ed6-a419-49d7-80cf-bf2df1b01c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:40.327920 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f87ed6-a419-49d7-80cf-bf2df1b01c9c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:40.402803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820013bd-526a-45c5-b946-bab2376515a2 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:40.406540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 713/1446] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:40.426792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820013bd-526a-45c5-b946-bab2376515a2 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:40.459206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719216f2-2e71-45f2-bb11-f61f1d2cc6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:40.460332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719216f2-2e71-45f2-bb11-f61f1d2cc6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:40.460893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719216f2-2e71-45f2-bb11-f61f1d2cc6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:40.464215 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719216f2-2e71-45f2-bb11-f61f1d2cc6ad admin admin] PATH_INFO: `/v3/projects/e7e21109590443a49f92ecd71cf587ec/users/eaa5976db5e0461ab5db92d537ab6b01/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:40.505609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719216f2-2e71-45f2-bb11-f61f1d2cc6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e21109590443a49f92ecd71cf587ec, user_id=eaa5976db5e0461ab5db92d537ab6b01, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:40.508452 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719216f2-2e71-45f2-bb11-f61f1d2cc6ad admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:40.558369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 734/1447] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:40 2022] PUT /identity/v3/projects/e7e21109590443a49f92ecd71cf587ec/users/eaa5976db5e0461ab5db92d537ab6b01/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:49:40.568967 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aa3fe-2330-4c08-9e05-de4a20a6e3e8 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:40.569307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aa3fe-2330-4c08-9e05-de4a20a6e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:40.569516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aa3fe-2330-4c08-9e05-de4a20a6e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:40.651519 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c87aa3fe-2330-4c08-9e05-de4a20a6e3e8 None None] MFA Rules not processed for user `eaa5976db5e0461ab5db92d537ab6b01`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:40.653449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c87aa3fe-2330-4c08-9e05-de4a20a6e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:40.985199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719216f2-2e71-45f2-bb11-f61f1d2cc6ad admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:40.988565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 714/1448] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:41.134882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32f1ed-f585-4e4e-bcfe-1b6971426423 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:41.134882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32f1ed-f585-4e4e-bcfe-1b6971426423 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:41.134882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32f1ed-f585-4e4e-bcfe-1b6971426423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:41.237114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ff32f1ed-f585-4e4e-bcfe-1b6971426423 None None] MFA Rules not processed for user `94fe5ae1c52648fc9507216f4ab8d240`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:41.245746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ff32f1ed-f585-4e4e-bcfe-1b6971426423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:41.272906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719216f2-2e71-45f2-bb11-f61f1d2cc6ad admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:41.294119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f649b-b154-43ce-a873-d8a9a2e14c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:41.294802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f649b-b154-43ce-a873-d8a9a2e14c91 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:41.295335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f649b-b154-43ce-a873-d8a9a2e14c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:41.295825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f649b-b154-43ce-a873-d8a9a2e14c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:41.296695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f649b-b154-43ce-a873-d8a9a2e14c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:41.314117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f649b-b154-43ce-a873-d8a9a2e14c91 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:41.420462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 735/1449] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:40 2022] POST /identity/v3/projects => generated 387 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:41.423479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f649b-b154-43ce-a873-d8a9a2e14c91 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:41.445651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:41.531128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 715/1450] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:41.653874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f649b-b154-43ce-a873-d8a9a2e14c91 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:41.669673 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d01a51-714f-4015-bec2-5f0f531598ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:41.670775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d01a51-714f-4015-bec2-5f0f531598ea admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:41.672670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d01a51-714f-4015-bec2-5f0f531598ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:41.673268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d01a51-714f-4015-bec2-5f0f531598ea admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:41.674133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d01a51-714f-4015-bec2-5f0f531598ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:41.682538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d01a51-714f-4015-bec2-5f0f531598ea admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:41.740384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 736/1451] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:41 2022] POST /identity/v3/users => generated 294 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:41.745209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32f1ed-f585-4e4e-bcfe-1b6971426423 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:41.768885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32f1ed-f585-4e4e-bcfe-1b6971426423 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:41.784942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cd22b-4766-434c-abe5-73b0ad9daf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:41.786199 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cd22b-4766-434c-abe5-73b0ad9daf8c admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:41.786877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cd22b-4766-434c-abe5-73b0ad9daf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:41.787532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cd22b-4766-434c-abe5-73b0ad9daf8c admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:41.788532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cd22b-4766-434c-abe5-73b0ad9daf8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:41.793878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cd22b-4766-434c-abe5-73b0ad9daf8c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:41.828179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d01a51-714f-4015-bec2-5f0f531598ea admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:41.838398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 716/1452] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:41.845495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d01a51-714f-4015-bec2-5f0f531598ea admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:41.854606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd6437-5138-429a-ab11-89e573f67bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:41.856075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd6437-5138-429a-ab11-89e573f67bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:41.856488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd6437-5138-429a-ab11-89e573f67bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:41.856988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd6437-5138-429a-ab11-89e573f67bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:41.858121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd6437-5138-429a-ab11-89e573f67bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:41.860275 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd6437-5138-429a-ab11-89e573f67bb4 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:41.886785 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cd22b-4766-434c-abe5-73b0ad9daf8c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:41.899433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 737/1453] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:41.903175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cd22b-4766-434c-abe5-73b0ad9daf8c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:41.909348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1143c-d823-4118-b024-0390e0cd69f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:41.910372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1143c-d823-4118-b024-0390e0cd69f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:41.910792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1143c-d823-4118-b024-0390e0cd69f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:41.911203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1143c-d823-4118-b024-0390e0cd69f7 admin admin] PATH_INFO: `/v3/projects/9f7d2b602e764da8b0b5a922dac0e1ba/users/a234dabd212e48f3bafe334fbf004fe8/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:41.933333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1143c-d823-4118-b024-0390e0cd69f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7d2b602e764da8b0b5a922dac0e1ba, user_id=a234dabd212e48f3bafe334fbf004fe8, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:41.936597 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1143c-d823-4118-b024-0390e0cd69f7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:41.991547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 717/1454] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:41 2022] PUT /identity/v3/projects/9f7d2b602e764da8b0b5a922dac0e1ba/users/a234dabd212e48f3bafe334fbf004fe8/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:42.002843 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc094f6-b308-4549-8fb9-9ca77e95fe60 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:42.003953 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc094f6-b308-4549-8fb9-9ca77e95fe60 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:42.004459 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc094f6-b308-4549-8fb9-9ca77e95fe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:42.072782 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-dcc094f6-b308-4549-8fb9-9ca77e95fe60 None None] MFA Rules not processed for user `a234dabd212e48f3bafe334fbf004fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:42.078701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-dcc094f6-b308-4549-8fb9-9ca77e95fe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:42.254704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 738/1455] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:42.255271 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1143c-d823-4118-b024-0390e0cd69f7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:42.465960 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:42.531869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1143c-d823-4118-b024-0390e0cd69f7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:42.539969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6dc50-84a6-44bb-8aa4-5fdd5b7a284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:42.545455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6dc50-84a6-44bb-8aa4-5fdd5b7a284f admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:42.545911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6dc50-84a6-44bb-8aa4-5fdd5b7a284f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:42.546336 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6dc50-84a6-44bb-8aa4-5fdd5b7a284f admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:42.548133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6dc50-84a6-44bb-8aa4-5fdd5b7a284f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:42.563550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6dc50-84a6-44bb-8aa4-5fdd5b7a284f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:42.662657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 718/1456] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:42 2022] POST /identity/v3/projects => generated 387 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:42.666629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc094f6-b308-4549-8fb9-9ca77e95fe60 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:42.682791 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc094f6-b308-4549-8fb9-9ca77e95fe60 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:42.858810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe69d4-4442-4d3c-a1da-14029be28b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:42.860149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe69d4-4442-4d3c-a1da-14029be28b3e admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:42.864323 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe69d4-4442-4d3c-a1da-14029be28b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:42.865737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe69d4-4442-4d3c-a1da-14029be28b3e admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:42.866883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe69d4-4442-4d3c-a1da-14029be28b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:42.875249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe69d4-4442-4d3c-a1da-14029be28b3e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:42.968194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 739/1457] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:42 2022] POST /identity/v3/users => generated 300 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:49:42.972596 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6dc50-84a6-44bb-8aa4-5fdd5b7a284f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:43.007438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6dc50-84a6-44bb-8aa4-5fdd5b7a284f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:43.021569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a037d-09d4-47a0-bcdb-e932414c56a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:43.022209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a037d-09d4-47a0-bcdb-e932414c56a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:43.022548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a037d-09d4-47a0-bcdb-e932414c56a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:43.022846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a037d-09d4-47a0-bcdb-e932414c56a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:43.023593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a037d-09d4-47a0-bcdb-e932414c56a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:43.027113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a037d-09d4-47a0-bcdb-e932414c56a1 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:43.048866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 719/1458] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:49:43.052955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe69d4-4442-4d3c-a1da-14029be28b3e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:43.060652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:43.071596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe69d4-4442-4d3c-a1da-14029be28b3e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:43.089788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48420cb-5ead-494c-b19a-488dee4c68bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:43.091005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48420cb-5ead-494c-b19a-488dee4c68bc admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:43.091538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48420cb-5ead-494c-b19a-488dee4c68bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:43.092085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48420cb-5ead-494c-b19a-488dee4c68bc admin admin] PATH_INFO: `/v3/projects/7859ed1274514564bf0b0e06ae2aa2c2/users/226a186da998459b972b9d292891cbc5/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:43.160963 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48420cb-5ead-494c-b19a-488dee4c68bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7859ed1274514564bf0b0e06ae2aa2c2, user_id=226a186da998459b972b9d292891cbc5, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:43.164194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48420cb-5ead-494c-b19a-488dee4c68bc admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:43.195855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 740/1459] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:43 2022] PUT /identity/v3/projects/7859ed1274514564bf0b0e06ae2aa2c2/users/226a186da998459b972b9d292891cbc5/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:43.200583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a037d-09d4-47a0-bcdb-e932414c56a1 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:43.232893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a037d-09d4-47a0-bcdb-e932414c56a1 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:43.408041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62692726-2f13-4f2c-8818-ad3a4f5d295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:43.409345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692726-2f13-4f2c-8818-ad3a4f5d295f admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:43.409842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692726-2f13-4f2c-8818-ad3a4f5d295f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:43.410386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692726-2f13-4f2c-8818-ad3a4f5d295f admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:43.411838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62692726-2f13-4f2c-8818-ad3a4f5d295f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:43.415066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62692726-2f13-4f2c-8818-ad3a4f5d295f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:43.477212 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 720/1460] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:43.477696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48420cb-5ead-494c-b19a-488dee4c68bc admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:43.502650 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48420cb-5ead-494c-b19a-488dee4c68bc admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:43.528192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e431c-393c-4e16-a4da-fb2af881b5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:43.534708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e431c-393c-4e16-a4da-fb2af881b5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:43.535143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e431c-393c-4e16-a4da-fb2af881b5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:43.535561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e431c-393c-4e16-a4da-fb2af881b5c4 admin admin] PATH_INFO: `/v3/projects/7859ed1274514564bf0b0e06ae2aa2c2/users/226a186da998459b972b9d292891cbc5/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:43.539711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e431c-393c-4e16-a4da-fb2af881b5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7859ed1274514564bf0b0e06ae2aa2c2, user_id=226a186da998459b972b9d292891cbc5, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:43.547388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e431c-393c-4e16-a4da-fb2af881b5c4 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:43.601029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 741/1461] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:43 2022] PUT /identity/v3/projects/7859ed1274514564bf0b0e06ae2aa2c2/users/226a186da998459b972b9d292891cbc5/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:43.613423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8453-09f9-4215-bd66-d92c5521b7ae None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:43.613980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8453-09f9-4215-bd66-d92c5521b7ae None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:43.614238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8453-09f9-4215-bd66-d92c5521b7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:43.658732 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5c8c8453-09f9-4215-bd66-d92c5521b7ae None None] MFA Rules not processed for user `226a186da998459b972b9d292891cbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:43.660327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5c8c8453-09f9-4215-bd66-d92c5521b7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:43.879368 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 721/1462] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:43.892975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e431c-393c-4e16-a4da-fb2af881b5c4 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:43.896382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3a8e431c-393c-4e16-a4da-fb2af881b5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:44.058340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e431c-393c-4e16-a4da-fb2af881b5c4 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:44.062506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fc6e2-47e2-4da6-97a2-0718a680246d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:44.063240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc6e2-47e2-4da6-97a2-0718a680246d service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:44.063598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc6e2-47e2-4da6-97a2-0718a680246d service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:44.064050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc6e2-47e2-4da6-97a2-0718a680246d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:44.091832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fc6e2-47e2-4da6-97a2-0718a680246d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:44.093308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fc6e2-47e2-4da6-97a2-0718a680246d service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:44.119385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 742/1463] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:44.609222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf9e0-1893-49f0-ae53-8e6daa2a1adf None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:44.609692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf9e0-1893-49f0-ae53-8e6daa2a1adf None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:44.610367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf9e0-1893-49f0-ae53-8e6daa2a1adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:44.767720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-8c7bf9e0-1893-49f0-ae53-8e6daa2a1adf None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:44.770382 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8c7bf9e0-1893-49f0-ae53-8e6daa2a1adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:44.793176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:45.022989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 722/1464] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:49:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:49:45.296619 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf9e0-1893-49f0-ae53-8e6daa2a1adf None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:45.297404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fc6e2-47e2-4da6-97a2-0718a680246d service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:45.297880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8c7bf9e0-1893-49f0-ae53-8e6daa2a1adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:45.302026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-744fc6e2-47e2-4da6-97a2-0718a680246d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:45.451563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fc6e2-47e2-4da6-97a2-0718a680246d service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:45.465336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:45.466292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:45.467635 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:45.468063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] PATH_INFO: `/v3/users/9ea47dc166e84119abf1cda279cf006b` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:45.472231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea47dc166e84119abf1cda279cf006b)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:45.488962 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:45.500402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf9e0-1893-49f0-ae53-8e6daa2a1adf None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:45.536763 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac2102-fd66-4f9d-bd94-f0dcb78545c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:45.543655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2102-fd66-4f9d-bd94-f0dcb78545c7 service swift] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:45.544094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2102-fd66-4f9d-bd94-f0dcb78545c7 service swift] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:45.544475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2102-fd66-4f9d-bd94-f0dcb78545c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:45.592177 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac2102-fd66-4f9d-bd94-f0dcb78545c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:45.598099 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac2102-fd66-4f9d-bd94-f0dcb78545c7 service swift] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:45.667400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 723/1465] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:49:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 04:49:45.674028 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac2102-fd66-4f9d-bd94-f0dcb78545c7 service swift] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:45.685757 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-58ac2102-fd66-4f9d-bd94-f0dcb78545c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:45.735920 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac2102-fd66-4f9d-bd94-f0dcb78545c7 service swift] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:45.750138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:45.752436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:45.754260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:45.754700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] PATH_INFO: `/v3/users/51c6b86a43bd435ea1dbefd42533d5d3` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:45.757174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea47dc166e84119abf1cda279cf006b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:45.762843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c6b86a43bd435ea1dbefd42533d5d3)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:45.768528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:45.806679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea47dc166e84119abf1cda279cf006b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:45.816783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea47dc166e84119abf1cda279cf006b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:45.819688 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea47dc166e84119abf1cda279cf006b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:45.848157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea47dc166e84119abf1cda279cf006b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:45.900843 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:45.959893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c6b86a43bd435ea1dbefd42533d5d3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:45.984981 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 743/1466] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:45 2022] DELETE /identity/v3/users/9ea47dc166e84119abf1cda279cf006b => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:49:45.987987 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:45.999657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:46.017097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c6b86a43bd435ea1dbefd42533d5d3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:46.019385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c6b86a43bd435ea1dbefd42533d5d3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:46.022029 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c6b86a43bd435ea1dbefd42533d5d3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:46.051621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-be03e870-0fb7-4c75-b37d-ebdf5bf7f232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c6b86a43bd435ea1dbefd42533d5d3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:46.084316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:46.097876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 724/1467] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:45 2022] DELETE /identity/v3/users/51c6b86a43bd435ea1dbefd42533d5d3 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:46.098778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98938b-ab63-4564-9e06-652208825e34 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:46.098910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98938b-ab63-4564-9e06-652208825e34 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:46.100742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98938b-ab63-4564-9e06-652208825e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:46.182139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-1f98938b-ab63-4564-9e06-652208825e34 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:46.184121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1f98938b-ab63-4564-9e06-652208825e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:46.276347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474799be-a9de-4778-8360-24aa37e56aca admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:46.436588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 725/1468] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:46.438391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc112-9a3e-4981-8184-51fdd758059b None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:46.438884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc112-9a3e-4981-8184-51fdd758059b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:46.439248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc112-9a3e-4981-8184-51fdd758059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:46.483841 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d9421-ff65-47ea-887c-bcd8645d7f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:46.486228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-8cadc112-9a3e-4981-8184-51fdd758059b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:46.486690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9421-ff65-47ea-887c-bcd8645d7f36 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:46.487698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8cadc112-9a3e-4981-8184-51fdd758059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:46.488232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9421-ff65-47ea-887c-bcd8645d7f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:46.488712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9421-ff65-47ea-887c-bcd8645d7f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:46.505854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c56d9421-ff65-47ea-887c-bcd8645d7f36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:46.531448 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 726/1469] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:46.532684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadc112-9a3e-4981-8184-51fdd758059b None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:46.539639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8cadc112-9a3e-4981-8184-51fdd758059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:46.768423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d9421-ff65-47ea-887c-bcd8645d7f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:46.771897 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d9421-ff65-47ea-887c-bcd8645d7f36 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:46.773750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadc112-9a3e-4981-8184-51fdd758059b None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:46.800899 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 744/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:46.803302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d9421-ff65-47ea-887c-bcd8645d7f36 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:46.806975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c56d9421-ff65-47ea-887c-bcd8645d7f36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:46.807373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53032982-08d8-44e4-adbe-410d3009bc40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:46.813797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53032982-08d8-44e4-adbe-410d3009bc40 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:46.814214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53032982-08d8-44e4-adbe-410d3009bc40 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:46.814631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53032982-08d8-44e4-adbe-410d3009bc40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:46.851971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d9421-ff65-47ea-887c-bcd8645d7f36 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:46.853023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53032982-08d8-44e4-adbe-410d3009bc40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:46.854565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53032982-08d8-44e4-adbe-410d3009bc40 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:46.875926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14de12-9724-4820-b644-1263b65a9b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:46.876560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14de12-9724-4820-b644-1263b65a9b9d service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:46.876843 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14de12-9724-4820-b644-1263b65a9b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:46.877112 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14de12-9724-4820-b644-1263b65a9b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:46.899218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 727/1471] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:46.912398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14de12-9724-4820-b644-1263b65a9b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:46.913871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14de12-9724-4820-b644-1263b65a9b9d service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:46.937184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 745/1472] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:47.625042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53032982-08d8-44e4-adbe-410d3009bc40 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:47.637480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-53032982-08d8-44e4-adbe-410d3009bc40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:47.714345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53032982-08d8-44e4-adbe-410d3009bc40 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:47.757220 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:47.760095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:47.762065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:47.763659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] PATH_INFO: `/v3/projects/a953a6c99852491686d8df8a2d477cf9` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:47.769658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a953a6c99852491686d8df8a2d477cf9)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:47.791630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:48.037265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a953a6c99852491686d8df8a2d477cf9', 'request_id': 'req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:48.049258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a953a6c99852491686d8df8a2d477cf9', 'request_id': 'req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:48.074890 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a953a6c99852491686d8df8a2d477cf9', 'request_id': 'req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:48.101790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] The token cache is being invalidate because project a953a6c99852491686d8df8a2d477cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:48.102404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:48.103596 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-1b5e2a5c-046d-4f65-963a-2ed1d44fe6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:48.111240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 728/1473] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:47 2022] DELETE /identity/v3/projects/a953a6c99852491686d8df8a2d477cf9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:48.112067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14de12-9724-4820-b644-1263b65a9b9d service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:48.128179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14de12-9724-4820-b644-1263b65a9b9d service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:48.314346 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:48.383373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:48.386153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:48.386492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:48.386825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] PATH_INFO: `/v3/users/777c7ee9531d47218cb05181b042ab5b` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:48.389498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=777c7ee9531d47218cb05181b042ab5b)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:48.394845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:48.544495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777c7ee9531d47218cb05181b042ab5b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:48.553667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777c7ee9531d47218cb05181b042ab5b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:48.554500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777c7ee9531d47218cb05181b042ab5b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:48.555087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777c7ee9531d47218cb05181b042ab5b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:48.582711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777c7ee9531d47218cb05181b042ab5b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:48.626964 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 746/1474] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:48 2022] DELETE /identity/v3/users/777c7ee9531d47218cb05181b042ab5b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:48.835400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3120c-29f3-4cc8-9f89-47215b123109 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:48.835975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3120c-29f3-4cc8-9f89-47215b123109 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:48.835975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3120c-29f3-4cc8-9f89-47215b123109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:48.889170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-98b3120c-29f3-4cc8-9f89-47215b123109 None None] MFA Rules not processed for user `dc59d3cc1fbc4d4382bffd8ae93075e1`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:48.901901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-98b3120c-29f3-4cc8-9f89-47215b123109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:48.955881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:49.108125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 729/1475] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Oct 12 04:49:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:49.200089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:49.202163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:49.228039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152757d-598b-4639-90fb-d663aa6083fc admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:49.240959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0b4c-32bf-419e-861b-65d18ac83d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:49.241598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0b4c-32bf-419e-861b-65d18ac83d12 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:49.241883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0b4c-32bf-419e-861b-65d18ac83d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:49.242161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0b4c-32bf-419e-861b-65d18ac83d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:49.253899 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0b4c-32bf-419e-861b-65d18ac83d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:49.255387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0b4c-32bf-419e-861b-65d18ac83d12 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:49.273711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 747/1476] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:49.975337 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3120c-29f3-4cc8-9f89-47215b123109 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:49.976904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-98b3120c-29f3-4cc8-9f89-47215b123109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:50.179135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3120c-29f3-4cc8-9f89-47215b123109 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:50.189481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:50.190147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:50.191268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:50.192383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] PATH_INFO: `/v3/projects/9ef5e93c49df4e5bb56c96ae333c814a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:50.194827 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef5e93c49df4e5bb56c96ae333c814a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:50.197594 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:50.326144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef5e93c49df4e5bb56c96ae333c814a', 'request_id': 'req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:50.334171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef5e93c49df4e5bb56c96ae333c814a', 'request_id': 'req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:50.346029 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef5e93c49df4e5bb56c96ae333c814a', 'request_id': 'req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:50.378008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0b4c-32bf-419e-861b-65d18ac83d12 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:50.380614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9deb0b4c-32bf-419e-861b-65d18ac83d12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:50.388476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] The token cache is being invalidate because project 9ef5e93c49df4e5bb56c96ae333c814a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:50.389219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:50.391738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5d5c6dd-c065-49ca-a255-a2bc0c465ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:50.397113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 730/1477] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:49 2022] DELETE /identity/v3/projects/9ef5e93c49df4e5bb56c96ae333c814a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:50.407051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5d2d-1ad0-4b38-a91b-92c93cfd52d7 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:50.407051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5d2d-1ad0-4b38-a91b-92c93cfd52d7 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:50.407051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5d2d-1ad0-4b38-a91b-92c93cfd52d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:50.436911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0b4c-32bf-419e-861b-65d18ac83d12 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:50.454239 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-360d5d2d-1ad0-4b38-a91b-92c93cfd52d7 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:50.455837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-360d5d2d-1ad0-4b38-a91b-92c93cfd52d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:50.601238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:50.638347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:50.640551 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:50.641352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:50.642446 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] PATH_INFO: `/v3/projects/874995e5a6cb49a7b32de86822135517` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:50.645478 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=874995e5a6cb49a7b32de86822135517)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:50.649150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 731/1478] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:50.650904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:50.657208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed642-e82f-4dc1-a9c3-d61792dad3ed None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:50.658119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed642-e82f-4dc1-a9c3-d61792dad3ed None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:50.658857 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed642-e82f-4dc1-a9c3-d61792dad3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:50.720551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-103ed642-e82f-4dc1-a9c3-d61792dad3ed None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:50.721999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-103ed642-e82f-4dc1-a9c3-d61792dad3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:50.757355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 732/1479] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:50.763384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed642-e82f-4dc1-a9c3-d61792dad3ed None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:50.779000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed642-e82f-4dc1-a9c3-d61792dad3ed None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:50.800666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874995e5a6cb49a7b32de86822135517', 'request_id': 'req-1fab61d4-3100-401b-aab0-276dde52c52a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:50.805434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:50.817473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874995e5a6cb49a7b32de86822135517', 'request_id': 'req-1fab61d4-3100-401b-aab0-276dde52c52a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:50.828616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874995e5a6cb49a7b32de86822135517', 'request_id': 'req-1fab61d4-3100-401b-aab0-276dde52c52a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:50.843965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] The token cache is being invalidate because project 874995e5a6cb49a7b32de86822135517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:50.845232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:50.846263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:50.852414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 748/1480] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:50 2022] DELETE /identity/v3/projects/874995e5a6cb49a7b32de86822135517 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:50.855799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:50.858364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:50.953779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab61d4-3100-401b-aab0-276dde52c52a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:50.960877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:50.961908 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:50.962702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:50.963181 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] PATH_INFO: `/v3/users/54de8377f0f944579ab96b223bf2cb71` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:50.964758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] RBAC: Authorizing `identity:delete_user(user_id=54de8377f0f944579ab96b223bf2cb71)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:50.968637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:51.006858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a662e-9658-4443-aebb-9a539150489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:51.010183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a662e-9658-4443-aebb-9a539150489a admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:51.011753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a662e-9658-4443-aebb-9a539150489a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:51.013666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a662e-9658-4443-aebb-9a539150489a admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:51.016427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a662e-9658-4443-aebb-9a539150489a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:51.018896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a662e-9658-4443-aebb-9a539150489a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:51.022658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a662e-9658-4443-aebb-9a539150489a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:51.083745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 733/1481] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:51.091447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a662e-9658-4443-aebb-9a539150489a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:51.097281 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d31a662e-9658-4443-aebb-9a539150489a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:51.124433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54de8377f0f944579ab96b223bf2cb71'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:51.152941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54de8377f0f944579ab96b223bf2cb71'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:51.155300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54de8377f0f944579ab96b223bf2cb71'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:51.157398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54de8377f0f944579ab96b223bf2cb71'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:51.171451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a662e-9658-4443-aebb-9a539150489a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:51.194145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c45ad-6eaf-4447-be4f-d046571eee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:51.195167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54de8377f0f944579ab96b223bf2cb71'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:51.198502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c45ad-6eaf-4447-be4f-d046571eee54 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:51.200075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c45ad-6eaf-4447-be4f-d046571eee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:51.200516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c45ad-6eaf-4447-be4f-d046571eee54 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:51.201157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c45ad-6eaf-4447-be4f-d046571eee54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:51.210070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c45ad-6eaf-4447-be4f-d046571eee54 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:51.242442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 749/1482] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:50 2022] DELETE /identity/v3/users/54de8377f0f944579ab96b223bf2cb71 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:51.318907 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:51.319648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 734/1483] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:51 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:51.321540 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:51.489404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52614903-d7e8-4d11-b75f-a74c26fa110b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:51.493995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:51.636674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf347d-3036-43fa-8715-441c0b4a8c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:51.638683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf347d-3036-43fa-8715-441c0b4a8c86 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:51.639925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf347d-3036-43fa-8715-441c0b4a8c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:51.640361 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf347d-3036-43fa-8715-441c0b4a8c86 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:51.642323 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf347d-3036-43fa-8715-441c0b4a8c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:51.647661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf347d-3036-43fa-8715-441c0b4a8c86 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:51.718508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 750/1484] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:51 2022] POST /identity/v3/users => generated 289 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:49:51.720088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c45ad-6eaf-4447-be4f-d046571eee54 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:51.759702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c45ad-6eaf-4447-be4f-d046571eee54 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:51.779316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf347d-3036-43fa-8715-441c0b4a8c86 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:51.782008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-32cf347d-3036-43fa-8715-441c0b4a8c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:51.800203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44609aa6-3df7-4c19-ab62-7fa3daa01a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:51.802090 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44609aa6-3df7-4c19-ab62-7fa3daa01a70 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:51.803841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44609aa6-3df7-4c19-ab62-7fa3daa01a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:51.804261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44609aa6-3df7-4c19-ab62-7fa3daa01a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:51.805132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44609aa6-3df7-4c19-ab62-7fa3daa01a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:51.811303 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44609aa6-3df7-4c19-ab62-7fa3daa01a70 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:51.812925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf347d-3036-43fa-8715-441c0b4a8c86 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:51.825312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:51.826168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:51.826690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:51.826921 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] PATH_INFO: `/v3/projects/f61501d8be4b482aa8016581e1637bd9` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:51.828263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61501d8be4b482aa8016581e1637bd9)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:51.830692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:51.833607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 735/1485] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:51.839066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44609aa6-3df7-4c19-ab62-7fa3daa01a70 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:51.866601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44609aa6-3df7-4c19-ab62-7fa3daa01a70 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:51.874034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f4083-a9b4-4db7-aff7-436fc807a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:51.874985 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f4083-a9b4-4db7-aff7-436fc807a4fe admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:51.875459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f4083-a9b4-4db7-aff7-436fc807a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:51.875897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f4083-a9b4-4db7-aff7-436fc807a4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:51.876703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f4083-a9b4-4db7-aff7-436fc807a4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:51.878692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f4083-a9b4-4db7-aff7-436fc807a4fe admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:51.892742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 736/1486] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:51.898090 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f4083-a9b4-4db7-aff7-436fc807a4fe admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:51.912503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f4083-a9b4-4db7-aff7-436fc807a4fe admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:51.931275 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61501d8be4b482aa8016581e1637bd9', 'request_id': 'req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:51.946252 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61501d8be4b482aa8016581e1637bd9', 'request_id': 'req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:51.959904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61501d8be4b482aa8016581e1637bd9', 'request_id': 'req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:51.988355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] The token cache is being invalidate because project f61501d8be4b482aa8016581e1637bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:51.988685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:51.989763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f0bca8b3-84cc-4fc9-b94b-9520e19b5b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:51.997058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 751/1487] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:51 2022] DELETE /identity/v3/projects/f61501d8be4b482aa8016581e1637bd9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:51.998817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddf347-00bb-4a94-bc1a-9bbf42514559 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:51.999395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddf347-00bb-4a94-bc1a-9bbf42514559 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:51.999665 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddf347-00bb-4a94-bc1a-9bbf42514559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:52.032799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f31f7-afaf-4c1c-9974-d2f22869a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:52.035124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f31f7-afaf-4c1c-9974-d2f22869a720 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:52.035922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f31f7-afaf-4c1c-9974-d2f22869a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:52.037484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f31f7-afaf-4c1c-9974-d2f22869a720 admin admin] PATH_INFO: `/v3/projects/c34797a7aeae4563a1ffb135674c7121/users/d9de13b017b74fdb89e3da7bcd484fca/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:52.041587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-5fddf347-00bb-4a94-bc1a-9bbf42514559 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:52.061586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5fddf347-00bb-4a94-bc1a-9bbf42514559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:52.101510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 752/1488] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:52.101728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f31f7-afaf-4c1c-9974-d2f22869a720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34797a7aeae4563a1ffb135674c7121, user_id=d9de13b017b74fdb89e3da7bcd484fca, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:52.103959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84efffd-a086-4f92-b951-03243e5b6111 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:52.103959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84efffd-a086-4f92-b951-03243e5b6111 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:52.104358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84efffd-a086-4f92-b951-03243e5b6111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:52.111603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f31f7-afaf-4c1c-9974-d2f22869a720 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:52.143017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 737/1489] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:51 2022] PUT /identity/v3/projects/c34797a7aeae4563a1ffb135674c7121/users/d9de13b017b74fdb89e3da7bcd484fca/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:49:52.153368 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b87842-82f2-4210-941e-5015a82a944e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:52.153662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b87842-82f2-4210-941e-5015a82a944e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:52.153946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b87842-82f2-4210-941e-5015a82a944e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:52.154674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b84efffd-a086-4f92-b951-03243e5b6111 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:52.158577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b84efffd-a086-4f92-b951-03243e5b6111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:52.211254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e5b87842-82f2-4210-941e-5015a82a944e None None] MFA Rules not processed for user `d9de13b017b74fdb89e3da7bcd484fca`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:52.213022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e5b87842-82f2-4210-941e-5015a82a944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:52.242119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:52.353034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 753/1490] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:52.354383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84efffd-a086-4f92-b951-03243e5b6111 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:52.381258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 738/1491] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:49:52.387010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84efffd-a086-4f92-b951-03243e5b6111 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:52.394891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c57c63-9829-45d4-ad7c-58a42df2ef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:52.395564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c57c63-9829-45d4-ad7c-58a42df2ef57 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:52.396046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c57c63-9829-45d4-ad7c-58a42df2ef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:52.396373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c57c63-9829-45d4-ad7c-58a42df2ef57 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:52.397350 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c57c63-9829-45d4-ad7c-58a42df2ef57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:49:52.397841 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c57c63-9829-45d4-ad7c-58a42df2ef57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:52.400531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c57c63-9829-45d4-ad7c-58a42df2ef57 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:52.404865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b87842-82f2-4210-941e-5015a82a944e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:52.406256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e5b87842-82f2-4210-941e-5015a82a944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:52.427503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:52.435627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 754/1492] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:49:52.441284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c57c63-9829-45d4-ad7c-58a42df2ef57 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:52.462528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c57c63-9829-45d4-ad7c-58a42df2ef57 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:52.471936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd476811-36e1-4d0b-b552-1e13b71dc3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:52.472710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd476811-36e1-4d0b-b552-1e13b71dc3df admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:52.473071 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd476811-36e1-4d0b-b552-1e13b71dc3df admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:52.473555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd476811-36e1-4d0b-b552-1e13b71dc3df admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:52.475325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd476811-36e1-4d0b-b552-1e13b71dc3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:52.479219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd476811-36e1-4d0b-b552-1e13b71dc3df admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:52.554938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 755/1493] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:52 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:52.556712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd476811-36e1-4d0b-b552-1e13b71dc3df admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:52.619654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b87842-82f2-4210-941e-5015a82a944e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:52.714805 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd476811-36e1-4d0b-b552-1e13b71dc3df admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:52.728646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4b23c-97f1-4216-880b-e254b9b977d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:52.729464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4b23c-97f1-4216-880b-e254b9b977d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:52.730277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4b23c-97f1-4216-880b-e254b9b977d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:52.731574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4b23c-97f1-4216-880b-e254b9b977d0 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:52.733952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4b23c-97f1-4216-880b-e254b9b977d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:52.739532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4b23c-97f1-4216-880b-e254b9b977d0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:52.807982 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 756/1494] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:52 2022] POST /identity/v3/users => generated 284 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:49:52.807982 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4b23c-97f1-4216-880b-e254b9b977d0 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:52.809233 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-37d4b23c-97f1-4216-880b-e254b9b977d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:52.952970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4b23c-97f1-4216-880b-e254b9b977d0 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:52.962898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c040a7e-527f-4bc3-89c2-aa345e8b145a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:52.963643 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040a7e-527f-4bc3-89c2-aa345e8b145a service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:52.963990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040a7e-527f-4bc3-89c2-aa345e8b145a service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:52.964335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040a7e-527f-4bc3-89c2-aa345e8b145a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:52.970738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0c040a7e-527f-4bc3-89c2-aa345e8b145a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:53.049792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297464b-09da-4354-b83a-2346b49a32be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c894579b2b2943409412afbbfe779aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:53.050549 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297464b-09da-4354-b83a-2346b49a32be service glance] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:53.050902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297464b-09da-4354-b83a-2346b49a32be service glance] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:53.051259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297464b-09da-4354-b83a-2346b49a32be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:53.116777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c040a7e-527f-4bc3-89c2-aa345e8b145a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:53.122841 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c040a7e-527f-4bc3-89c2-aa345e8b145a service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:53.162775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 757/1495] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:53.163813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c040a7e-527f-4bc3-89c2-aa345e8b145a service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:53.200159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c040a7e-527f-4bc3-89c2-aa345e8b145a service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:53.220870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297464b-09da-4354-b83a-2346b49a32be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:53.225740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297464b-09da-4354-b83a-2346b49a32be service glance] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:53.229002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:53.230560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da9ff-7013-4adf-b53e-a472017d3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:53.231601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da9ff-7013-4adf-b53e-a472017d3827 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:53.232136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da9ff-7013-4adf-b53e-a472017d3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:53.234866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 739/1496] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 830 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:53.236115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da9ff-7013-4adf-b53e-a472017d3827 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:53.243424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286da9ff-7013-4adf-b53e-a472017d3827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:53.248117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286da9ff-7013-4adf-b53e-a472017d3827 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:53.295476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 758/1497] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:53.298845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297464b-09da-4354-b83a-2346b49a32be service glance] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:53.327486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297464b-09da-4354-b83a-2346b49a32be service glance] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:53.350640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e044ed6-804c-4e2f-b61c-ea581618b772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:53.352391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e044ed6-804c-4e2f-b61c-ea581618b772 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:53.352683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e044ed6-804c-4e2f-b61c-ea581618b772 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:53.356758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e044ed6-804c-4e2f-b61c-ea581618b772 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:53.357586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e044ed6-804c-4e2f-b61c-ea581618b772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:53.359332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e044ed6-804c-4e2f-b61c-ea581618b772 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:53.423414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 740/1498] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:53.427258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da9ff-7013-4adf-b53e-a472017d3827 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:53.441353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da9ff-7013-4adf-b53e-a472017d3827 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:53.460731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef6336-4cdc-4c24-8a0f-a830222b6911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:53.469455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef6336-4cdc-4c24-8a0f-a830222b6911 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:53.469746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef6336-4cdc-4c24-8a0f-a830222b6911 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:53.470029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef6336-4cdc-4c24-8a0f-a830222b6911 admin admin] PATH_INFO: `/v3/projects/45e740c000014221a391682113795051/users/e840b31f370e4ee5b7019142fde7eb17/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:53.493009 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:53.512576 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef6336-4cdc-4c24-8a0f-a830222b6911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e740c000014221a391682113795051, user_id=e840b31f370e4ee5b7019142fde7eb17, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:53.518531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef6336-4cdc-4c24-8a0f-a830222b6911 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:53.596532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 759/1499] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:53 2022] PUT /identity/v3/projects/45e740c000014221a391682113795051/users/e840b31f370e4ee5b7019142fde7eb17/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:53.609639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51177-81da-47a0-9e16-dd700f7b1e6e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:53.610766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51177-81da-47a0-9e16-dd700f7b1e6e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:53.611517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51177-81da-47a0-9e16-dd700f7b1e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:53.728977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6ed51177-81da-47a0-9e16-dd700f7b1e6e None None] MFA Rules not processed for user `e840b31f370e4ee5b7019142fde7eb17`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:53.730658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6ed51177-81da-47a0-9e16-dd700f7b1e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:54.036049 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 741/1500] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:49:54.041396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef6336-4cdc-4c24-8a0f-a830222b6911 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:54.290698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef6336-4cdc-4c24-8a0f-a830222b6911 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:54.297619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c53163-16c5-4b0f-94f6-986965de17eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:54.298698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53163-16c5-4b0f-94f6-986965de17eb admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:54.299404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53163-16c5-4b0f-94f6-986965de17eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:54.299907 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c53163-16c5-4b0f-94f6-986965de17eb admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:54.300742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c53163-16c5-4b0f-94f6-986965de17eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:54.302870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c53163-16c5-4b0f-94f6-986965de17eb admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:54.344641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 760/1501] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:49:54 2022] POST /identity/v3/projects => generated 369 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:54.347730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51177-81da-47a0-9e16-dd700f7b1e6e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:54.364134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51177-81da-47a0-9e16-dd700f7b1e6e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:54.556453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c15f-d3cf-4152-9df8-266074b0f97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:54.559625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c15f-d3cf-4152-9df8-266074b0f97b admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:54.559625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c15f-d3cf-4152-9df8-266074b0f97b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:54.559625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c15f-d3cf-4152-9df8-266074b0f97b admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:54.559625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1c15f-d3cf-4152-9df8-266074b0f97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:54.568957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1c15f-d3cf-4152-9df8-266074b0f97b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:54.638412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 742/1502] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:49:54 2022] POST /identity/v3/users => generated 291 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:49:54.642518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c53163-16c5-4b0f-94f6-986965de17eb admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:54.660974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c53163-16c5-4b0f-94f6-986965de17eb admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:54.677989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fee80a-35c4-4ddc-b615-0f0a4deda610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:54.678884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fee80a-35c4-4ddc-b615-0f0a4deda610 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:54.679370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fee80a-35c4-4ddc-b615-0f0a4deda610 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:54.679831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fee80a-35c4-4ddc-b615-0f0a4deda610 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:54.680739 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fee80a-35c4-4ddc-b615-0f0a4deda610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:54.685620 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fee80a-35c4-4ddc-b615-0f0a4deda610 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:54.748026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 761/1503] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:54.751848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c15f-d3cf-4152-9df8-266074b0f97b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:54.782135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c15f-d3cf-4152-9df8-266074b0f97b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:54.800588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69055-ffeb-4443-9cc2-d65a47455a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:54.801397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69055-ffeb-4443-9cc2-d65a47455a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:54.801681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69055-ffeb-4443-9cc2-d65a47455a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:54.801955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69055-ffeb-4443-9cc2-d65a47455a49 admin admin] PATH_INFO: `/v3/projects/c1020e067ac344f1bf005a0c3c20c212/users/85f8f989481046169aed38694ef4bac5/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:54.867462 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c69055-ffeb-4443-9cc2-d65a47455a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1020e067ac344f1bf005a0c3c20c212, user_id=85f8f989481046169aed38694ef4bac5, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:54.870338 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c69055-ffeb-4443-9cc2-d65a47455a49 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:54.899628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 743/1504] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:54 2022] PUT /identity/v3/projects/c1020e067ac344f1bf005a0c3c20c212/users/85f8f989481046169aed38694ef4bac5/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:54.904244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fee80a-35c4-4ddc-b615-0f0a4deda610 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:54.921923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fee80a-35c4-4ddc-b615-0f0a4deda610 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:55.108276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90d56c-0712-4bec-af37-3b8bf9fad442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:55.111020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90d56c-0712-4bec-af37-3b8bf9fad442 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:55.111020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90d56c-0712-4bec-af37-3b8bf9fad442 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:55.111020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90d56c-0712-4bec-af37-3b8bf9fad442 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:55.115046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90d56c-0712-4bec-af37-3b8bf9fad442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:55.116763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90d56c-0712-4bec-af37-3b8bf9fad442 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:55.139038 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 762/1505] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:49:55.142931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69055-ffeb-4443-9cc2-d65a47455a49 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:55.182374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7a105-a2d0-47a1-83bd-bde0234a06e5 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:55.182711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7a105-a2d0-47a1-83bd-bde0234a06e5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:55.182935 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7a105-a2d0-47a1-83bd-bde0234a06e5 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:55.184732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 763/1506] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:49:55 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:49:55.186598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69055-ffeb-4443-9cc2-d65a47455a49 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:55.208351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdab9a3-93c4-4b1c-a3ae-bfa5bae26621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:55.209932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdab9a3-93c4-4b1c-a3ae-bfa5bae26621 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:55.211738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdab9a3-93c4-4b1c-a3ae-bfa5bae26621 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:55.213635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdab9a3-93c4-4b1c-a3ae-bfa5bae26621 admin admin] PATH_INFO: `/v3/projects/c1020e067ac344f1bf005a0c3c20c212/users/85f8f989481046169aed38694ef4bac5/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:55.217669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdab9a3-93c4-4b1c-a3ae-bfa5bae26621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1020e067ac344f1bf005a0c3c20c212, user_id=85f8f989481046169aed38694ef4bac5, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:55.226901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdab9a3-93c4-4b1c-a3ae-bfa5bae26621 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:55.254857 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 744/1507] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:49:55 2022] PUT /identity/v3/projects/c1020e067ac344f1bf005a0c3c20c212/users/85f8f989481046169aed38694ef4bac5/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:55.274115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28b3e-dad9-4513-accb-93b97e363154 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:55.276714 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28b3e-dad9-4513-accb-93b97e363154 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:55.277923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f28b3e-dad9-4513-accb-93b97e363154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:55.314714 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adb05f-dcf3-4dae-9f79-21642344d6a9 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:55.315355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adb05f-dcf3-4dae-9f79-21642344d6a9 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:55.316433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adb05f-dcf3-4dae-9f79-21642344d6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:55.350217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-60adb05f-dcf3-4dae-9f79-21642344d6a9 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:55.353329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-60adb05f-dcf3-4dae-9f79-21642344d6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:55.368161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-21f28b3e-dad9-4513-accb-93b97e363154 None None] MFA Rules not processed for user `85f8f989481046169aed38694ef4bac5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:55.370797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-21f28b3e-dad9-4513-accb-93b97e363154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:55.426292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:55.490650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 745/1508] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:49:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:49:55.515688 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60adb05f-dcf3-4dae-9f79-21642344d6a9 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:55.518684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-60adb05f-dcf3-4dae-9f79-21642344d6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:55.542540 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:55.627240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 764/1509] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:55.635077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e305-423d-4bcf-a0df-3cda0ad15a36 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:55.635166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e305-423d-4bcf-a0df-3cda0ad15a36 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:55.636770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e305-423d-4bcf-a0df-3cda0ad15a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:55.718492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a5f4e305-423d-4bcf-a0df-3cda0ad15a36 None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:55.720902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a5f4e305-423d-4bcf-a0df-3cda0ad15a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:55.759532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60adb05f-dcf3-4dae-9f79-21642344d6a9 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:55.779863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a545d-c768-4ad6-948a-821a1e310784 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:55.782653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a545d-c768-4ad6-948a-821a1e310784 service swift] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:55.782945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a545d-c768-4ad6-948a-821a1e310784 service swift] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:55.783224 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a545d-c768-4ad6-948a-821a1e310784 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:55.828382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 765/1510] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:49:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:55.829516 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4e305-423d-4bcf-a0df-3cda0ad15a36 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:55.831235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a5f4e305-423d-4bcf-a0df-3cda0ad15a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:55.835573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a545d-c768-4ad6-948a-821a1e310784 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:55.838042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a545d-c768-4ad6-948a-821a1e310784 service swift] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:55.868837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 746/1511] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:49:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:49:55.894737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb865a-94bf-43e0-8e6f-3009e4b1f2cb None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:55.895558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb865a-94bf-43e0-8e6f-3009e4b1f2cb None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:55.895938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb865a-94bf-43e0-8e6f-3009e4b1f2cb None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:55.899905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 747/1512] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:49:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:49:55.939174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94a60-8dd9-49df-94c6-90e53222dab9 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:55.939695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94a60-8dd9-49df-94c6-90e53222dab9 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:55.940260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94a60-8dd9-49df-94c6-90e53222dab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:55.968059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4e305-423d-4bcf-a0df-3cda0ad15a36 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:55.980815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f85e2-72b7-48d6-bef3-58ef5d80f188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:55.985793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f85e2-72b7-48d6-bef3-58ef5d80f188 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:55.986605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f85e2-72b7-48d6-bef3-58ef5d80f188 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:55.986605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f85e2-72b7-48d6-bef3-58ef5d80f188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:55.994171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b8d94a60-8dd9-49df-94c6-90e53222dab9 None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:56.001137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b8d94a60-8dd9-49df-94c6-90e53222dab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:56.021060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f85e2-72b7-48d6-bef3-58ef5d80f188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:56.031862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f85e2-72b7-48d6-bef3-58ef5d80f188 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:56.041719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 748/1513] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:49:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:56.056699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 766/1514] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:56.150167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d94a60-8dd9-49df-94c6-90e53222dab9 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:56.169072 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d94a60-8dd9-49df-94c6-90e53222dab9 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:56.205951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270956ad-8160-4d87-8034-83739c5bb47e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:56.209711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270956ad-8160-4d87-8034-83739c5bb47e service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:56.211026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270956ad-8160-4d87-8034-83739c5bb47e service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:56.212084 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270956ad-8160-4d87-8034-83739c5bb47e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:56.385910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270956ad-8160-4d87-8034-83739c5bb47e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:56.388501 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270956ad-8160-4d87-8034-83739c5bb47e service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:56.431347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 749/1515] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:57.226525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f85e2-72b7-48d6-bef3-58ef5d80f188 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:57.228615 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1a1f85e2-72b7-48d6-bef3-58ef5d80f188 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:57.459974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f85e2-72b7-48d6-bef3-58ef5d80f188 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:57.472629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:57.472629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:57.473220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:57.473768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] PATH_INFO: `/v3/users/b854171b69354c5a894e04f78f630eac` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:57.475506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b854171b69354c5a894e04f78f630eac)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:57.478547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:57.507811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270956ad-8160-4d87-8034-83739c5bb47e service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:57.511321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-270956ad-8160-4d87-8034-83739c5bb47e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:57.526179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:57.552185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270956ad-8160-4d87-8034-83739c5bb47e service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:57.572935 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:57.577115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:57.577115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:57.577115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] PATH_INFO: `/v3/users/eaa5976db5e0461ab5db92d537ab6b01` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:57.578041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa5976db5e0461ab5db92d537ab6b01)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:57.581143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:57.586440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b854171b69354c5a894e04f78f630eac'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:57.596049 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b854171b69354c5a894e04f78f630eac'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:57.596910 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b854171b69354c5a894e04f78f630eac'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:57.597545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b854171b69354c5a894e04f78f630eac'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:57.615322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f18cc417-a240-4f93-85a7-105e2cb8bd1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b854171b69354c5a894e04f78f630eac'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:57.670398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 767/1516] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:57 2022] DELETE /identity/v3/users/b854171b69354c5a894e04f78f630eac => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:57.672436 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46555-85a3-4024-8116-82bd6cf5e8c3 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:57.672975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46555-85a3-4024-8116-82bd6cf5e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:57.673442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46555-85a3-4024-8116-82bd6cf5e8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:57.717993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-fde46555-85a3-4024-8116-82bd6cf5e8c3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:57.720213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fde46555-85a3-4024-8116-82bd6cf5e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:57.737075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa5976db5e0461ab5db92d537ab6b01'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:57.755585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:57.768414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa5976db5e0461ab5db92d537ab6b01'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:57.772971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa5976db5e0461ab5db92d537ab6b01'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:57.779446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa5976db5e0461ab5db92d537ab6b01'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:57.803370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3601ea81-d0ec-4c4f-9f19-ffabb8342575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa5976db5e0461ab5db92d537ab6b01'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:57.809509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 768/1517] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:57.836913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde46555-85a3-4024-8116-82bd6cf5e8c3 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:57.838594 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fde46555-85a3-4024-8116-82bd6cf5e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:57.850760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 750/1518] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:57 2022] DELETE /identity/v3/users/eaa5976db5e0461ab5db92d537ab6b01 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:57.856186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3af03-b94c-47cf-a8e6-79294f48c982 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:57.858045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3af03-b94c-47cf-a8e6-79294f48c982 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:57.858550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3af03-b94c-47cf-a8e6-79294f48c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:57.906433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-22f3af03-b94c-47cf-a8e6-79294f48c982 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:49:57.910094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-22f3af03-b94c-47cf-a8e6-79294f48c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:57.979553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde46555-85a3-4024-8116-82bd6cf5e8c3 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:58.012396 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 751/1519] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:49:58.027491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3af03-b94c-47cf-a8e6-79294f48c982 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:58.134787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19e90b-090d-42c1-aaf4-0cd26aad7316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:58.135478 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19e90b-090d-42c1-aaf4-0cd26aad7316 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:58.135763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19e90b-090d-42c1-aaf4-0cd26aad7316 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:58.136039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19e90b-090d-42c1-aaf4-0cd26aad7316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:58.145017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:58.148782 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19e90b-090d-42c1-aaf4-0cd26aad7316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:58.151243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19e90b-090d-42c1-aaf4-0cd26aad7316 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:58.151786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3af03-b94c-47cf-a8e6-79294f48c982 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:58.161741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb338064-c39d-45f4-9096-da56e252a844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:58.162797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb338064-c39d-45f4-9096-da56e252a844 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:58.163515 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb338064-c39d-45f4-9096-da56e252a844 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:58.163947 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 769/1520] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:58.168087 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb338064-c39d-45f4-9096-da56e252a844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:58.185008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb338064-c39d-45f4-9096-da56e252a844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:58.186627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb338064-c39d-45f4-9096-da56e252a844 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:58.208069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 752/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:58.385170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19e90b-090d-42c1-aaf4-0cd26aad7316 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:58.389329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fe19e90b-090d-42c1-aaf4-0cd26aad7316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:58.664618 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19e90b-090d-42c1-aaf4-0cd26aad7316 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:58.691022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adf575-f8c5-4589-be85-b59282f0cab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:58.691852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adf575-f8c5-4589-be85-b59282f0cab8 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:58.692127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adf575-f8c5-4589-be85-b59282f0cab8 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:58.692401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adf575-f8c5-4589-be85-b59282f0cab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:58.698462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-42adf575-f8c5-4589-be85-b59282f0cab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:58.723011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adf575-f8c5-4589-be85-b59282f0cab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:58.725513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adf575-f8c5-4589-be85-b59282f0cab8 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:58.756100 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 770/1522] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:58.913862 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb338064-c39d-45f4-9096-da56e252a844 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:58.933373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb338064-c39d-45f4-9096-da56e252a844 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:58.941116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd0951-44da-46d7-9cea-499b9ee87781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:58.942430 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd0951-44da-46d7-9cea-499b9ee87781 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:58.942820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd0951-44da-46d7-9cea-499b9ee87781 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:58.945415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd0951-44da-46d7-9cea-499b9ee87781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:58.949625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2ddd0951-44da-46d7-9cea-499b9ee87781 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:58.971217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd0951-44da-46d7-9cea-499b9ee87781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:58.973586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd0951-44da-46d7-9cea-499b9ee87781 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:58.997812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adf575-f8c5-4589-be85-b59282f0cab8 service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:58.999426 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-42adf575-f8c5-4589-be85-b59282f0cab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:59.000304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 753/1523] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:49:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:49:59.027047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adf575-f8c5-4589-be85-b59282f0cab8 service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:59.045979 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:59.054859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:59.056203 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:59.056876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] PATH_INFO: `/v3/projects/52fd14ce2ae348a3b9184832d69df0ae` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:59.058433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd0951-44da-46d7-9cea-499b9ee87781 service nova] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:59.060444 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2ddd0951-44da-46d7-9cea-499b9ee87781 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:59.061273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fd14ce2ae348a3b9184832d69df0ae)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:59.067778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:59.088434 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd0951-44da-46d7-9cea-499b9ee87781 service nova] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:59.115149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:59.117554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:59.117969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:59.119169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] PATH_INFO: `/v3/projects/e7e21109590443a49f92ecd71cf587ec` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:59.123266 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e21109590443a49f92ecd71cf587ec)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:59.126655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:59.261305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fd14ce2ae348a3b9184832d69df0ae', 'request_id': 'req-907fb1f6-c772-4d23-9141-9de164ad34a8'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.284474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fd14ce2ae348a3b9184832d69df0ae', 'request_id': 'req-907fb1f6-c772-4d23-9141-9de164ad34a8'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.301737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e21109590443a49f92ecd71cf587ec', 'request_id': 'req-4139a280-7219-4d01-a60f-bba951fb42a7'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.302968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fd14ce2ae348a3b9184832d69df0ae', 'request_id': 'req-907fb1f6-c772-4d23-9141-9de164ad34a8'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.311600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e21109590443a49f92ecd71cf587ec', 'request_id': 'req-4139a280-7219-4d01-a60f-bba951fb42a7'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.314905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:59.322184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] The token cache is being invalidate because project 52fd14ce2ae348a3b9184832d69df0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:59.322407 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.323384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.326240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e21109590443a49f92ecd71cf587ec', 'request_id': 'req-4139a280-7219-4d01-a60f-bba951fb42a7'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.329745 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 771/1524] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:58 2022] DELETE /identity/v3/projects/52fd14ce2ae348a3b9184832d69df0ae => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:49:59.337475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:59.340505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:59.351192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] The token cache is being invalidate because project e7e21109590443a49f92ecd71cf587ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:49:59.351567 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.352940 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.362259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 754/1525] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:49:59 2022] DELETE /identity/v3/projects/e7e21109590443a49f92ecd71cf587ec => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:59.375524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:49:59.377286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:49:59.433446 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fb1f6-c772-4d23-9141-9de164ad34a8 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:59.443748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:49:59.454687 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a280-7219-4d01-a60f-bba951fb42a7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:49:59.460787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:59.462102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:59.462673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:59.463050 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] PATH_INFO: `/v3/users/a234dabd212e48f3bafe334fbf004fe8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:59.464753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a234dabd212e48f3bafe334fbf004fe8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:59.466973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:59.534948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:49:59.535743 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a234dabd212e48f3bafe334fbf004fe8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.535908 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:49:59.536092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:49:59.536328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] PATH_INFO: `/v3/users/724bf2608ed541ffb908ee7fc8d6d879` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:49:59.538140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724bf2608ed541ffb908ee7fc8d6d879)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:49:59.540285 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:49:59.544417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a234dabd212e48f3bafe334fbf004fe8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.545755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a234dabd212e48f3bafe334fbf004fe8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.546267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a234dabd212e48f3bafe334fbf004fe8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.555306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a234dabd212e48f3bafe334fbf004fe8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.596013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 755/1526] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:59 2022] DELETE /identity/v3/users/a234dabd212e48f3bafe334fbf004fe8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:49:59.631717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724bf2608ed541ffb908ee7fc8d6d879'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.639730 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724bf2608ed541ffb908ee7fc8d6d879'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.640464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724bf2608ed541ffb908ee7fc8d6d879'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.641238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724bf2608ed541ffb908ee7fc8d6d879'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.663320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724bf2608ed541ffb908ee7fc8d6d879'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:49:59.696634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 772/1527] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:49:59 2022] DELETE /identity/v3/users/724bf2608ed541ffb908ee7fc8d6d879 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:00.205773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:00.207211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:00.279971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:00.281328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:00.390336 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708f8f6-305a-4ab9-97d4-c1236c403b90 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:00.424059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:00.465984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dce5f-b539-45b7-80e4-cb86ae89a9f5 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:00.472391 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:00.474197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:00.474890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:00.482832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] PATH_INFO: `/v3/projects/cd8f6522d5ee4866b7b53bce3cab9254` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:00.484417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8f6522d5ee4866b7b53bce3cab9254)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:00.487161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:00.510277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:00.511159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:00.511760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:00.512651 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] PATH_INFO: `/v3/projects/9f7d2b602e764da8b0b5a922dac0e1ba` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:00.514158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7d2b602e764da8b0b5a922dac0e1ba)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:00.517320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:00.550397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:00.573293 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8f6522d5ee4866b7b53bce3cab9254', 'request_id': 'req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.592086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8f6522d5ee4866b7b53bce3cab9254', 'request_id': 'req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.627484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8f6522d5ee4866b7b53bce3cab9254', 'request_id': 'req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.645909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] The token cache is being invalidate because project cd8f6522d5ee4866b7b53bce3cab9254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:00.647267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.648414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c28c5b37-a1ad-4838-80a5-82fb00a2b4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.658545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 773/1528] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:00 2022] DELETE /identity/v3/projects/cd8f6522d5ee4866b7b53bce3cab9254 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:00.663428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678f52c-2d08-4349-be45-f961043aa18b None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:00.667062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678f52c-2d08-4349-be45-f961043aa18b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:00.667598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678f52c-2d08-4349-be45-f961043aa18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:00.674999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7d2b602e764da8b0b5a922dac0e1ba', 'request_id': 'req-3edb4c00-e695-4709-846f-1312500d4486'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.691995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7d2b602e764da8b0b5a922dac0e1ba', 'request_id': 'req-3edb4c00-e695-4709-846f-1312500d4486'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.692874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d678f52c-2d08-4349-be45-f961043aa18b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:00.694862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d678f52c-2d08-4349-be45-f961043aa18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:00.708944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7d2b602e764da8b0b5a922dac0e1ba', 'request_id': 'req-3edb4c00-e695-4709-846f-1312500d4486'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.733833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] The token cache is being invalidate because project 9f7d2b602e764da8b0b5a922dac0e1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:00.734133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.737517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.743793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 756/1529] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:00 2022] DELETE /identity/v3/projects/9f7d2b602e764da8b0b5a922dac0e1ba => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:00.746043 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:00.748155 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:00.807502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 774/1530] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:00.809937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df1958-866a-493a-b446-aaab0dcbabcf None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:00.810295 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df1958-866a-493a-b446-aaab0dcbabcf None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:00.810576 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df1958-866a-493a-b446-aaab0dcbabcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:00.833837 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-04df1958-866a-493a-b446-aaab0dcbabcf None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:00.835114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-04df1958-866a-493a-b446-aaab0dcbabcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:00.840273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb4c00-e695-4709-846f-1312500d4486 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:00.846965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:00.847948 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:00.848371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:00.849084 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] PATH_INFO: `/v3/users/226a186da998459b972b9d292891cbc5` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:00.853808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=226a186da998459b972b9d292891cbc5)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:00.854829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 775/1531] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:00.856152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df1958-866a-493a-b446-aaab0dcbabcf None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:00.857508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:00.868954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df1958-866a-493a-b446-aaab0dcbabcf None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:00.879413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58cb97-76d8-496e-ae72-38f514a57b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:00.880028 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58cb97-76d8-496e-ae72-38f514a57b7c admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:00.880307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58cb97-76d8-496e-ae72-38f514a57b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:00.880633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58cb97-76d8-496e-ae72-38f514a57b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:00.881279 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58cb97-76d8-496e-ae72-38f514a57b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:00.881589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58cb97-76d8-496e-ae72-38f514a57b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:00.885179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58cb97-76d8-496e-ae72-38f514a57b7c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:00.901424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 776/1532] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:50:00.906117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58cb97-76d8-496e-ae72-38f514a57b7c admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:00.910409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:00.917384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226a186da998459b972b9d292891cbc5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.920170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58cb97-76d8-496e-ae72-38f514a57b7c admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:00.925477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8441-92ff-4177-b573-69efb89071c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:00.926512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8441-92ff-4177-b573-69efb89071c0 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:00.926891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8441-92ff-4177-b573-69efb89071c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:00.927170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8441-92ff-4177-b573-69efb89071c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:00.928112 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226a186da998459b972b9d292891cbc5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.928238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c8441-92ff-4177-b573-69efb89071c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:00.929631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226a186da998459b972b9d292891cbc5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.930035 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c8441-92ff-4177-b573-69efb89071c0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:00.931829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226a186da998459b972b9d292891cbc5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.953153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226a186da998459b972b9d292891cbc5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:00.967272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 777/1533] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:00 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:00.971546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8441-92ff-4177-b573-69efb89071c0 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:00.973477 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-628c8441-92ff-4177-b573-69efb89071c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:00.987723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 757/1534] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:00 2022] DELETE /identity/v3/users/226a186da998459b972b9d292891cbc5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:01.096951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8441-92ff-4177-b573-69efb89071c0 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:01.125608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:01.191024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:01.192495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:01.193794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bfe8e-f277-4398-bca7-a590fb6b52b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:01.194523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bfe8e-f277-4398-bca7-a590fb6b52b0 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.195024 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bfe8e-f277-4398-bca7-a590fb6b52b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.195476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bfe8e-f277-4398-bca7-a590fb6b52b0 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.196581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bfe8e-f277-4398-bca7-a590fb6b52b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:01.199032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bfe8e-f277-4398-bca7-a590fb6b52b0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:01.219328 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3df00c-3bb6-4f44-a30f-cec766511eee admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:01.226315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:01.227637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.228404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.229276 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] PATH_INFO: `/v3/users/e840b31f370e4ee5b7019142fde7eb17` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.230725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e840b31f370e4ee5b7019142fde7eb17)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:01.237991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 778/1535] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:00 2022] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:01.239642 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bfe8e-f277-4398-bca7-a590fb6b52b0 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:01.251054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:01.254207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bfe8e-f277-4398-bca7-a590fb6b52b0 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:01.259719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18c7df-05c9-45a8-be0d-01c9a14f5d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:01.260634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c7df-05c9-45a8-be0d-01c9a14f5d29 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.261020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c7df-05c9-45a8-be0d-01c9a14f5d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.261397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c7df-05c9-45a8-be0d-01c9a14f5d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.262351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18c7df-05c9-45a8-be0d-01c9a14f5d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:01.265545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18c7df-05c9-45a8-be0d-01c9a14f5d29 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:01.296218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 779/1536] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:01.301425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18c7df-05c9-45a8-be0d-01c9a14f5d29 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:01.319563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18c7df-05c9-45a8-be0d-01c9a14f5d29 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:01.325720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cb767-908b-43ce-b5cb-517406df8b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:01.326727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cb767-908b-43ce-b5cb-517406df8b4f admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.327422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cb767-908b-43ce-b5cb-517406df8b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.327853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cb767-908b-43ce-b5cb-517406df8b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.328647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cb767-908b-43ce-b5cb-517406df8b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:01.331063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cb767-908b-43ce-b5cb-517406df8b4f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:01.349661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e840b31f370e4ee5b7019142fde7eb17'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:01.349994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 780/1537] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:01.351196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cb767-908b-43ce-b5cb-517406df8b4f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:01.360025 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e840b31f370e4ee5b7019142fde7eb17'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:01.362786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e840b31f370e4ee5b7019142fde7eb17'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:01.364195 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e840b31f370e4ee5b7019142fde7eb17'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:01.365044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cb767-908b-43ce-b5cb-517406df8b4f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:01.370408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5da8e8-3a9a-43c2-8ccd-8ebb12a693fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:01.371315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da8e8-3a9a-43c2-8ccd-8ebb12a693fa admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.371769 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da8e8-3a9a-43c2-8ccd-8ebb12a693fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.372053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5da8e8-3a9a-43c2-8ccd-8ebb12a693fa admin admin] PATH_INFO: `/v3/projects/ce5fd36280a94c32aaa485d9a6cae046/users/30bea6fcfba3431b9f8ae1c3a6cde5dd/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.378618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e840b31f370e4ee5b7019142fde7eb17'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:01.389254 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5da8e8-3a9a-43c2-8ccd-8ebb12a693fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5fd36280a94c32aaa485d9a6cae046, user_id=30bea6fcfba3431b9f8ae1c3a6cde5dd, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:01.392263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5da8e8-3a9a-43c2-8ccd-8ebb12a693fa admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:01.399549 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 758/1538] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:01 2022] DELETE /identity/v3/users/e840b31f370e4ee5b7019142fde7eb17 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:01.401599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:01.403335 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:01.412734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 781/1539] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:01 2022] PUT /identity/v3/projects/ce5fd36280a94c32aaa485d9a6cae046/users/30bea6fcfba3431b9f8ae1c3a6cde5dd/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:01.414182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c296d-de12-4712-a457-6b8638df31ce None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.414571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c296d-de12-4712-a457-6b8638df31ce None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.417066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c296d-de12-4712-a457-6b8638df31ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.484369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-605c296d-de12-4712-a457-6b8638df31ce None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:01.485640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-605c296d-de12-4712-a457-6b8638df31ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:01.557362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e86a81-1835-4426-8920-9c608773c5c1 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:01.596678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:01.601413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 782/1540] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:01.604975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de38577-1ffa-4da6-9e00-9d265bdc1d27 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.605678 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de38577-1ffa-4da6-9e00-9d265bdc1d27 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.606145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de38577-1ffa-4da6-9e00-9d265bdc1d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.632069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:01.635919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.636460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.636883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] PATH_INFO: `/v3/projects/7859ed1274514564bf0b0e06ae2aa2c2` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.638279 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7859ed1274514564bf0b0e06ae2aa2c2)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:01.641696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:01.643838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-9de38577-1ffa-4da6-9e00-9d265bdc1d27 None None] MFA Rules not processed for user `30bea6fcfba3431b9f8ae1c3a6cde5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:01.645397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9de38577-1ffa-4da6-9e00-9d265bdc1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:01.719714 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7859ed1274514564bf0b0e06ae2aa2c2', 'request_id': 'req-20a6d6b7-0209-407a-8b05-88c4f4f7770e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:01.733083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7859ed1274514564bf0b0e06ae2aa2c2', 'request_id': 'req-20a6d6b7-0209-407a-8b05-88c4f4f7770e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:01.749806 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7859ed1274514564bf0b0e06ae2aa2c2', 'request_id': 'req-20a6d6b7-0209-407a-8b05-88c4f4f7770e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:01.757808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:01.764985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 783/1541] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:01.766172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] The token cache is being invalidate because project 7859ed1274514564bf0b0e06ae2aa2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:01.766591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:01.768439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de38577-1ffa-4da6-9e00-9d265bdc1d27 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:01.769001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:01.771046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 759/1542] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:01 2022] DELETE /identity/v3/projects/7859ed1274514564bf0b0e06ae2aa2c2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:01.772006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:01.773424 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:01.775975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9de38577-1ffa-4da6-9e00-9d265bdc1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:01.869678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6d6b7-0209-407a-8b05-88c4f4f7770e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:01.871686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de38577-1ffa-4da6-9e00-9d265bdc1d27 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:01.877216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ddff7-704a-4170-b446-e46347a7cbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:01.877840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ddff7-704a-4170-b446-e46347a7cbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.878233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ddff7-704a-4170-b446-e46347a7cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.878564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ddff7-704a-4170-b446-e46347a7cbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.879191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ddff7-704a-4170-b446-e46347a7cbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:01.881740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ddff7-704a-4170-b446-e46347a7cbc5 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:01.919018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 760/1543] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:01 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:01.920380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b07f6-c472-4a95-a819-15b0a991baa1 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.920674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b07f6-c472-4a95-a819-15b0a991baa1 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.920951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b07f6-c472-4a95-a819-15b0a991baa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.944869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5492e29-6fbc-418d-b6f7-2ecb8a2c5d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:01.945110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-3e9b07f6-c472-4a95-a819-15b0a991baa1 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:01.945661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5492e29-6fbc-418d-b6f7-2ecb8a2c5d61 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:01.945959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5492e29-6fbc-418d-b6f7-2ecb8a2c5d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:01.946237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5492e29-6fbc-418d-b6f7-2ecb8a2c5d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:01.946527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-3e9b07f6-c472-4a95-a819-15b0a991baa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:01.948010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d5492e29-6fbc-418d-b6f7-2ecb8a2c5d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:01.961125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5492e29-6fbc-418d-b6f7-2ecb8a2c5d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:01.963158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5492e29-6fbc-418d-b6f7-2ecb8a2c5d61 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:01.974880 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 784/1544] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:01.976306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5492e29-6fbc-418d-b6f7-2ecb8a2c5d61 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.005945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:02.019074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5492e29-6fbc-418d-b6f7-2ecb8a2c5d61 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.025366 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 761/1545] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:02.032859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836b675-a396-4f84-90f1-fc6357e9b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.034212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836b675-a396-4f84-90f1-fc6357e9b7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.034616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836b675-a396-4f84-90f1-fc6357e9b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.034943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836b675-a396-4f84-90f1-fc6357e9b7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.035913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836b675-a396-4f84-90f1-fc6357e9b7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.037339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dc680-bf78-4cce-a7a3-3c89556be467 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.038007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dc680-bf78-4cce-a7a3-3c89556be467 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.038474 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dc680-bf78-4cce-a7a3-3c89556be467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.038890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836b675-a396-4f84-90f1-fc6357e9b7c6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.065373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-138dc680-bf78-4cce-a7a3-3c89556be467 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:02.067513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-138dc680-bf78-4cce-a7a3-3c89556be467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:02.068337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 785/1546] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:01 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:02.073434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836b675-a396-4f84-90f1-fc6357e9b7c6 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.079068 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 762/1547] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:02.084551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dc680-bf78-4cce-a7a3-3c89556be467 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.088312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836b675-a396-4f84-90f1-fc6357e9b7c6 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.094321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2041e68-6138-4486-8c5a-a81ebeb55427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.094962 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2041e68-6138-4486-8c5a-a81ebeb55427 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.095428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2041e68-6138-4486-8c5a-a81ebeb55427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.095713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2041e68-6138-4486-8c5a-a81ebeb55427 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.096932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2041e68-6138-4486-8c5a-a81ebeb55427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.098383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dc680-bf78-4cce-a7a3-3c89556be467 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.098591 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2041e68-6138-4486-8c5a-a81ebeb55427 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.107119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aad8f-707f-4516-9d54-9c6ca750b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.108475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aad8f-707f-4516-9d54-9c6ca750b859 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.109095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aad8f-707f-4516-9d54-9c6ca750b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.109586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aad8f-707f-4516-9d54-9c6ca750b859 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.110424 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82aad8f-707f-4516-9d54-9c6ca750b859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:02.111014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82aad8f-707f-4516-9d54-9c6ca750b859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.111775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 786/1548] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:02.113441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82aad8f-707f-4516-9d54-9c6ca750b859 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.116180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2041e68-6138-4486-8c5a-a81ebeb55427 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.129228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 763/1549] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:50:02.130619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2041e68-6138-4486-8c5a-a81ebeb55427 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.134087 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aad8f-707f-4516-9d54-9c6ca750b859 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.139748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecee03-d8a2-453b-ad8b-5286ea370889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.140438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecee03-d8a2-453b-ad8b-5286ea370889 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.140723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecee03-d8a2-453b-ad8b-5286ea370889 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.141001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecee03-d8a2-453b-ad8b-5286ea370889 admin admin] PATH_INFO: `/v3/projects/83cfc4212bf348ebb417d2eb4a15a08c/users/d529a1c717594d4bb83fbac8faf3a63e/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.149507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aad8f-707f-4516-9d54-9c6ca750b859 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.155847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8ce2b-7ae8-4a02-ac22-fbcdf4cca313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.157265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8ce2b-7ae8-4a02-ac22-fbcdf4cca313 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.157764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8ce2b-7ae8-4a02-ac22-fbcdf4cca313 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.158222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8ce2b-7ae8-4a02-ac22-fbcdf4cca313 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.159215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8ce2b-7ae8-4a02-ac22-fbcdf4cca313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.162449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8ce2b-7ae8-4a02-ac22-fbcdf4cca313 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.163300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecee03-d8a2-453b-ad8b-5286ea370889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cfc4212bf348ebb417d2eb4a15a08c, user_id=d529a1c717594d4bb83fbac8faf3a63e, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.186751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecee03-d8a2-453b-ad8b-5286ea370889 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.213442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 787/1550] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:02 2022] PUT /identity/v3/projects/83cfc4212bf348ebb417d2eb4a15a08c/users/d529a1c717594d4bb83fbac8faf3a63e/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:02.214467 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecee03-d8a2-453b-ad8b-5286ea370889 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.224248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 764/1551] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:02 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:02.225442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8ce2b-7ae8-4a02-ac22-fbcdf4cca313 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.310687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecee03-d8a2-453b-ad8b-5286ea370889 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.329627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:02.340212 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8ce2b-7ae8-4a02-ac22-fbcdf4cca313 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.346102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7269d6c-a244-4be3-85bf-6346f36e27f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.347410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7269d6c-a244-4be3-85bf-6346f36e27f3 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.347702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7269d6c-a244-4be3-85bf-6346f36e27f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.347981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7269d6c-a244-4be3-85bf-6346f36e27f3 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.348634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7269d6c-a244-4be3-85bf-6346f36e27f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.350765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7269d6c-a244-4be3-85bf-6346f36e27f3 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.381852 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 765/1552] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:02 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:02.386705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7269d6c-a244-4be3-85bf-6346f36e27f3 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.417950 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7269d6c-a244-4be3-85bf-6346f36e27f3 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.423064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6877-f176-4438-bdbb-f4e49abc7fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.423723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6877-f176-4438-bdbb-f4e49abc7fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.424009 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6877-f176-4438-bdbb-f4e49abc7fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.424286 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6877-f176-4438-bdbb-f4e49abc7fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.424601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56a9d6-24e2-4dc6-90f9-109f31dd1f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.424934 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6877-f176-4438-bdbb-f4e49abc7fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.425200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56a9d6-24e2-4dc6-90f9-109f31dd1f87 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.426959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6877-f176-4438-bdbb-f4e49abc7fe6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.434301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56a9d6-24e2-4dc6-90f9-109f31dd1f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.434735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56a9d6-24e2-4dc6-90f9-109f31dd1f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.435569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56a9d6-24e2-4dc6-90f9-109f31dd1f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.437367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56a9d6-24e2-4dc6-90f9-109f31dd1f87 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.439334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 788/1553] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:02.458773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 766/1554] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:02.458773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56a9d6-24e2-4dc6-90f9-109f31dd1f87 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.467052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6877-f176-4438-bdbb-f4e49abc7fe6 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.470676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9bff6877-f176-4438-bdbb-f4e49abc7fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:02.472233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56a9d6-24e2-4dc6-90f9-109f31dd1f87 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.481371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f99de-4715-4637-a419-b872884e05ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.482869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f99de-4715-4637-a419-b872884e05ae admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.483223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f99de-4715-4637-a419-b872884e05ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.483602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f99de-4715-4637-a419-b872884e05ae admin admin] PATH_INFO: `/v3/projects/83cfc4212bf348ebb417d2eb4a15a08c/users/d529a1c717594d4bb83fbac8faf3a63e/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.485060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6877-f176-4438-bdbb-f4e49abc7fe6 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.485808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f99de-4715-4637-a419-b872884e05ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cfc4212bf348ebb417d2eb4a15a08c, user_id=d529a1c717594d4bb83fbac8faf3a63e, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.488625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f99de-4715-4637-a419-b872884e05ae admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.490017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.490734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.491016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.491307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] PATH_INFO: `/v3/projects/45e740c000014221a391682113795051` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.492647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e740c000014221a391682113795051)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.495970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.504554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 767/1555] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:02 2022] PUT /identity/v3/projects/83cfc4212bf348ebb417d2eb4a15a08c/users/d529a1c717594d4bb83fbac8faf3a63e/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:02.504762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f99de-4715-4637-a419-b872884e05ae admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.591161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e740c000014221a391682113795051', 'request_id': 'req-57682045-e466-4b3e-a7cc-d31607bafb9e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:02.601606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e740c000014221a391682113795051', 'request_id': 'req-57682045-e466-4b3e-a7cc-d31607bafb9e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:02.609523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e740c000014221a391682113795051', 'request_id': 'req-57682045-e466-4b3e-a7cc-d31607bafb9e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:02.611123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f99de-4715-4637-a419-b872884e05ae admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.623336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] The token cache is being invalidate because project 45e740c000014221a391682113795051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:02.623597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:02.624372 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-57682045-e466-4b3e-a7cc-d31607bafb9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:02.627010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 789/1556] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:02 2022] DELETE /identity/v3/projects/45e740c000014221a391682113795051 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:02.631029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60fd39-869d-405d-b784-5a3af433684f None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.631411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60fd39-869d-405d-b784-5a3af433684f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.632147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60fd39-869d-405d-b784-5a3af433684f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.645815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:02.680685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-df60fd39-869d-405d-b784-5a3af433684f None None] MFA Rules not processed for user `d529a1c717594d4bb83fbac8faf3a63e`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:02.681962 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-df60fd39-869d-405d-b784-5a3af433684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:02.686787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573c30b-1f86-4276-a1c3-3cf283b2e09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.687513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c30b-1f86-4276-a1c3-3cf283b2e09e admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.687798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c30b-1f86-4276-a1c3-3cf283b2e09e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.688072 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c30b-1f86-4276-a1c3-3cf283b2e09e admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.689355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573c30b-1f86-4276-a1c3-3cf283b2e09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.691777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573c30b-1f86-4276-a1c3-3cf283b2e09e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.704524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 768/1557] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:02.709428 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573c30b-1f86-4276-a1c3-3cf283b2e09e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.712248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2573c30b-1f86-4276-a1c3-3cf283b2e09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:02.732380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573c30b-1f86-4276-a1c3-3cf283b2e09e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.739553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.740196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.740556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.740930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] PATH_INFO: `/v3/users/85f8f989481046169aed38694ef4bac5` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.748835 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f8f989481046169aed38694ef4bac5)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.752441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.785175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 790/1558] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:02.786002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60fd39-869d-405d-b784-5a3af433684f None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.788144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-df60fd39-869d-405d-b784-5a3af433684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:02.818003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60fd39-869d-405d-b784-5a3af433684f None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:02.829954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2245b-8765-4bb6-989a-666fcc11301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:02.830709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2245b-8765-4bb6-989a-666fcc11301f admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.831001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2245b-8765-4bb6-989a-666fcc11301f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.831353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2245b-8765-4bb6-989a-666fcc11301f admin admin] PATH_INFO: `/v3/projects/c97652698a7240f2a92c264bd45e3620/users/0bf57a2db8354013b3daa8b79f56c81e/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.834281 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f8f989481046169aed38694ef4bac5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:02.849319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f8f989481046169aed38694ef4bac5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:02.851120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f8f989481046169aed38694ef4bac5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:02.853482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f8f989481046169aed38694ef4bac5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:02.865794 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f525fb7-4f89-4b26-9c2a-26f28fb0173b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f8f989481046169aed38694ef4bac5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:02.866720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2245b-8765-4bb6-989a-666fcc11301f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97652698a7240f2a92c264bd45e3620, user_id=0bf57a2db8354013b3daa8b79f56c81e, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:02.872135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2245b-8765-4bb6-989a-666fcc11301f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:02.874784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:02.890965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 791/1559] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:02 2022] PUT /identity/v3/projects/c97652698a7240f2a92c264bd45e3620/users/0bf57a2db8354013b3daa8b79f56c81e/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:02.892051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2245b-8765-4bb6-989a-666fcc11301f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:02.894142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fdc2245b-8765-4bb6-989a-666fcc11301f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:02.894337 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 769/1560] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:02 2022] DELETE /identity/v3/users/85f8f989481046169aed38694ef4bac5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:02.903182 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3ace-1513-4919-975c-f220a77da36e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:02.903827 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3ace-1513-4919-975c-f220a77da36e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:02.904117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3ace-1513-4919-975c-f220a77da36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:02.936967 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-13fc3ace-1513-4919-975c-f220a77da36e None None] MFA Rules not processed for user `0bf57a2db8354013b3daa8b79f56c81e`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:02.938254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-13fc3ace-1513-4919-975c-f220a77da36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:02.979996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2245b-8765-4bb6-989a-666fcc11301f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:03.031975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 770/1561] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:03.033219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc3ace-1513-4919-975c-f220a77da36e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:03.034997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-13fc3ace-1513-4919-975c-f220a77da36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:03.069277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:03.087042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24089b5b-34d4-43af-984c-e505932a4c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:03.088415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24089b5b-34d4-43af-984c-e505932a4c43 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.088957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24089b5b-34d4-43af-984c-e505932a4c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.090268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24089b5b-34d4-43af-984c-e505932a4c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.094737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-24089b5b-34d4-43af-984c-e505932a4c43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:03.184678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc3ace-1513-4919-975c-f220a77da36e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:03.190639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e748caa-1e51-40d3-8e5e-68c9a463a945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:03.192096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748caa-1e51-40d3-8e5e-68c9a463a945 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.192529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748caa-1e51-40d3-8e5e-68c9a463a945 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.193699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748caa-1e51-40d3-8e5e-68c9a463a945 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.194609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e748caa-1e51-40d3-8e5e-68c9a463a945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:03.196800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e748caa-1e51-40d3-8e5e-68c9a463a945 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:03.202971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24089b5b-34d4-43af-984c-e505932a4c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:03.206383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24089b5b-34d4-43af-984c-e505932a4c43 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:03.219765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 792/1562] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:03.236404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 771/1563] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:03 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:03.241488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24089b5b-34d4-43af-984c-e505932a4c43 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:03.257735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24089b5b-34d4-43af-984c-e505932a4c43 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:03.323054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e748caa-1e51-40d3-8e5e-68c9a463a945 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:03.325069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6e748caa-1e51-40d3-8e5e-68c9a463a945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:03.345984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40380b7-bffb-4588-81ba-60d928fc4df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:03.346652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40380b7-bffb-4588-81ba-60d928fc4df9 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.347120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40380b7-bffb-4588-81ba-60d928fc4df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.347445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40380b7-bffb-4588-81ba-60d928fc4df9 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.348112 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40380b7-bffb-4588-81ba-60d928fc4df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:03.352048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40380b7-bffb-4588-81ba-60d928fc4df9 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:03.364433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:03.392627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 793/1564] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:03 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:03.393800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40380b7-bffb-4588-81ba-60d928fc4df9 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:03.406576 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40380b7-bffb-4588-81ba-60d928fc4df9 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:03.415761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4108e-82dc-4009-bbcc-993a29d23fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:03.416396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4108e-82dc-4009-bbcc-993a29d23fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.416680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4108e-82dc-4009-bbcc-993a29d23fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.416956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4108e-82dc-4009-bbcc-993a29d23fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.417870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4108e-82dc-4009-bbcc-993a29d23fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:03.419873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4108e-82dc-4009-bbcc-993a29d23fa5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:03.432783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 794/1565] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:03.437184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4108e-82dc-4009-bbcc-993a29d23fa5 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:03.448658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e748caa-1e51-40d3-8e5e-68c9a463a945 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:03.450147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4108e-82dc-4009-bbcc-993a29d23fa5 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:03.456228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451a681-9ae3-4903-af6e-cf11f12f9697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:03.457087 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:03.457231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451a681-9ae3-4903-af6e-cf11f12f9697 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.457521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451a681-9ae3-4903-af6e-cf11f12f9697 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.458205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451a681-9ae3-4903-af6e-cf11f12f9697 admin admin] PATH_INFO: `/v3/projects/e3574cd034cf415286f461f10ba78dcc/users/46d171d6e4384ab9bc26478cbb15e282/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.458915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.465209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.465567 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] PATH_INFO: `/v3/projects/c1020e067ac344f1bf005a0c3c20c212` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.470263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1020e067ac344f1bf005a0c3c20c212)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:03.474289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:03.485671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451a681-9ae3-4903-af6e-cf11f12f9697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3574cd034cf415286f461f10ba78dcc, user_id=46d171d6e4384ab9bc26478cbb15e282, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:03.493948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451a681-9ae3-4903-af6e-cf11f12f9697 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:03.531884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 795/1566] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:03 2022] PUT /identity/v3/projects/e3574cd034cf415286f461f10ba78dcc/users/46d171d6e4384ab9bc26478cbb15e282/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:03.534067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451a681-9ae3-4903-af6e-cf11f12f9697 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:03.623607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1020e067ac344f1bf005a0c3c20c212', 'request_id': 'req-a8de794e-494a-46aa-a6dc-bccd352cfefa'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:03.666080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1020e067ac344f1bf005a0c3c20c212', 'request_id': 'req-a8de794e-494a-46aa-a6dc-bccd352cfefa'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:03.731697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1020e067ac344f1bf005a0c3c20c212', 'request_id': 'req-a8de794e-494a-46aa-a6dc-bccd352cfefa'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:03.761029 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] The token cache is being invalidate because project c1020e067ac344f1bf005a0c3c20c212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:03.761843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:03.762936 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a8de794e-494a-46aa-a6dc-bccd352cfefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:03.765591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 772/1567] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:03 2022] DELETE /identity/v3/projects/c1020e067ac344f1bf005a0c3c20c212 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:03.771299 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50987a-a5a3-473c-a631-91e5226914b5 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.771749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50987a-a5a3-473c-a631-91e5226914b5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.772133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50987a-a5a3-473c-a631-91e5226914b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.800194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-df50987a-a5a3-473c-a631-91e5226914b5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:03.802026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-df50987a-a5a3-473c-a631-91e5226914b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:03.809028 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451a681-9ae3-4903-af6e-cf11f12f9697 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:03.847198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:03.882714 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 773/1568] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:03.890816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011eb8-c67e-4652-8f4a-1bbb92891ec5 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.891188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011eb8-c67e-4652-8f4a-1bbb92891ec5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.891574 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011eb8-c67e-4652-8f4a-1bbb92891ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.900940 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7f466-fbdd-4ab6-bb83-dc7a08d8a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:03.901841 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7f466-fbdd-4ab6-bb83-dc7a08d8a794 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.902025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7f466-fbdd-4ab6-bb83-dc7a08d8a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.902312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7f466-fbdd-4ab6-bb83-dc7a08d8a794 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.903219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7f466-fbdd-4ab6-bb83-dc7a08d8a794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:03.904994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7f466-fbdd-4ab6-bb83-dc7a08d8a794 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:03.929355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-d4011eb8-c67e-4652-8f4a-1bbb92891ec5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:03.931454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d4011eb8-c67e-4652-8f4a-1bbb92891ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:03.942858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 796/1569] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:03.943756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 774/1570] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:03.950885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4011eb8-c67e-4652-8f4a-1bbb92891ec5 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:03.952296 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d4011eb8-c67e-4652-8f4a-1bbb92891ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:03.956472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7f466-fbdd-4ab6-bb83-dc7a08d8a794 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:03.967316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4011eb8-c67e-4652-8f4a-1bbb92891ec5 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:03.975247 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568fc43-4529-42de-a22f-50896e3a74ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:03.976640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568fc43-4529-42de-a22f-50896e3a74ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.977120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568fc43-4529-42de-a22f-50896e3a74ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.977536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568fc43-4529-42de-a22f-50896e3a74ad admin admin] PATH_INFO: `/v3/projects/e3574cd034cf415286f461f10ba78dcc/users/46d171d6e4384ab9bc26478cbb15e282/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.978980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7f466-fbdd-4ab6-bb83-dc7a08d8a794 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:03.980741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568fc43-4529-42de-a22f-50896e3a74ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3574cd034cf415286f461f10ba78dcc, user_id=46d171d6e4384ab9bc26478cbb15e282, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:03.983807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568fc43-4529-42de-a22f-50896e3a74ad admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:03.993879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dc10a-18bf-439a-aee3-cc14e5c6e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:03.994503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dc10a-18bf-439a-aee3-cc14e5c6e32a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:03.994772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dc10a-18bf-439a-aee3-cc14e5c6e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:03.995048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dc10a-18bf-439a-aee3-cc14e5c6e32a admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:03.995754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dc10a-18bf-439a-aee3-cc14e5c6e32a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:03.996024 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dc10a-18bf-439a-aee3-cc14e5c6e32a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:03.997640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dc10a-18bf-439a-aee3-cc14e5c6e32a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:04.011817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 775/1571] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:03 2022] PUT /identity/v3/projects/e3574cd034cf415286f461f10ba78dcc/users/46d171d6e4384ab9bc26478cbb15e282/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:04.017269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa8aa7-c381-4d25-8000-c0f11544d6e1 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.017732 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa8aa7-c381-4d25-8000-c0f11544d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.018012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa8aa7-c381-4d25-8000-c0f11544d6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.026378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 797/1572] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:50:04.030421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dc10a-18bf-439a-aee3-cc14e5c6e32a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:04.044149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dc10a-18bf-439a-aee3-cc14e5c6e32a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:04.069704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-75fa8aa7-c381-4d25-8000-c0f11544d6e1 None None] MFA Rules not processed for user `46d171d6e4384ab9bc26478cbb15e282`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:04.071549 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-75fa8aa7-c381-4d25-8000-c0f11544d6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:04.120087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:04.133710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7112ed-af2a-47d0-9967-bdeef8aecbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:04.134332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7112ed-af2a-47d0-9967-bdeef8aecbce admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.134617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7112ed-af2a-47d0-9967-bdeef8aecbce admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.135045 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7112ed-af2a-47d0-9967-bdeef8aecbce admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.135733 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7112ed-af2a-47d0-9967-bdeef8aecbce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:04.138159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7112ed-af2a-47d0-9967-bdeef8aecbce admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:04.162106 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 776/1573] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:04.169399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 798/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:04 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:04.170851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa8aa7-c381-4d25-8000-c0f11544d6e1 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:04.174636 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7112ed-af2a-47d0-9967-bdeef8aecbce admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:04.176293 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9e7112ed-af2a-47d0-9967-bdeef8aecbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:04.181468 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa8aa7-c381-4d25-8000-c0f11544d6e1 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:04.236671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7112ed-af2a-47d0-9967-bdeef8aecbce admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:04.241489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ae35c-25df-4de7-bfe8-dae094353954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:04.242575 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ae35c-25df-4de7-bfe8-dae094353954 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.244260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ae35c-25df-4de7-bfe8-dae094353954 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.244738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ae35c-25df-4de7-bfe8-dae094353954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.245614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45cd01-7883-4d47-ab78-05e06d3238ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:04.246527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45cd01-7883-4d47-ab78-05e06d3238ae admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.246808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45cd01-7883-4d47-ab78-05e06d3238ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.247746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45cd01-7883-4d47-ab78-05e06d3238ae admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.248385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45cd01-7883-4d47-ab78-05e06d3238ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:04.250346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45cd01-7883-4d47-ab78-05e06d3238ae admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:04.273251 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 777/1575] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:04 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:04.278598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45cd01-7883-4d47-ab78-05e06d3238ae admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:04.290662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45cd01-7883-4d47-ab78-05e06d3238ae admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:04.295443 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5dc2b-d3ec-40f6-b24b-fb9b38a9d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:04.296075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5dc2b-d3ec-40f6-b24b-fb9b38a9d8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.296332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5dc2b-d3ec-40f6-b24b-fb9b38a9d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.296707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5dc2b-d3ec-40f6-b24b-fb9b38a9d8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.297476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5dc2b-d3ec-40f6-b24b-fb9b38a9d8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:04.299819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5dc2b-d3ec-40f6-b24b-fb9b38a9d8a5 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:04.314822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 778/1576] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:04.316158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5dc2b-d3ec-40f6-b24b-fb9b38a9d8a5 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:04.319864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ae35c-25df-4de7-bfe8-dae094353954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:04.321980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ae35c-25df-4de7-bfe8-dae094353954 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:04.328273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5dc2b-d3ec-40f6-b24b-fb9b38a9d8a5 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:04.333564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 799/1577] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:04.335191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421a1e5-9823-4998-9277-e4c7ea5bd272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:04.335840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a1e5-9823-4998-9277-e4c7ea5bd272 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.336126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a1e5-9823-4998-9277-e4c7ea5bd272 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.336490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a1e5-9823-4998-9277-e4c7ea5bd272 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.337121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421a1e5-9823-4998-9277-e4c7ea5bd272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:04.338706 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421a1e5-9823-4998-9277-e4c7ea5bd272 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:04.349946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 779/1578] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:04.354721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ae35c-25df-4de7-bfe8-dae094353954 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:04.368525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ae35c-25df-4de7-bfe8-dae094353954 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:04.375239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ac0f2-25aa-44bd-a76c-bd1472849d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:04.375957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ac0f2-25aa-44bd-a76c-bd1472849d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.376237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ac0f2-25aa-44bd-a76c-bd1472849d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.376514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ac0f2-25aa-44bd-a76c-bd1472849d6d admin admin] PATH_INFO: `/v3/projects/8ca9ccf3c20b4a2ca50ad3a5b0f23f6e/users/3dd7785c7b7b4ee29dd0862f59577a53/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.395373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ac0f2-25aa-44bd-a76c-bd1472849d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca9ccf3c20b4a2ca50ad3a5b0f23f6e, user_id=3dd7785c7b7b4ee29dd0862f59577a53, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:04.398509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ac0f2-25aa-44bd-a76c-bd1472849d6d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:04.413708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 800/1579] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:04 2022] PUT /identity/v3/projects/8ca9ccf3c20b4a2ca50ad3a5b0f23f6e/users/3dd7785c7b7b4ee29dd0862f59577a53/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:04.414335 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421a1e5-9823-4998-9277-e4c7ea5bd272 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:04.425810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d1fe-5e0e-4356-bd77-3b158db75cd7 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.426112 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d1fe-5e0e-4356-bd77-3b158db75cd7 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.426367 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d1fe-5e0e-4356-bd77-3b158db75cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.429749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421a1e5-9823-4998-9277-e4c7ea5bd272 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:04.438849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:04.456631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-7155d1fe-5e0e-4356-bd77-3b158db75cd7 None None] MFA Rules not processed for user `3dd7785c7b7b4ee29dd0862f59577a53`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:04.458125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-7155d1fe-5e0e-4356-bd77-3b158db75cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:04.486749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8ec6e-9f95-4292-8de3-7eac7ec7716f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:04.487404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ec6e-9f95-4292-8de3-7eac7ec7716f service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.487693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ec6e-9f95-4292-8de3-7eac7ec7716f service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.487975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ec6e-9f95-4292-8de3-7eac7ec7716f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.489806 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-aec8ec6e-9f95-4292-8de3-7eac7ec7716f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:04.513850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:04.535206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 801/1580] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:04.540297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d1fe-5e0e-4356-bd77-3b158db75cd7 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:04.616900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8ec6e-9f95-4292-8de3-7eac7ec7716f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:04.623404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8ec6e-9f95-4292-8de3-7eac7ec7716f service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:04.637752 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 780/1581] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:04.732272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d1fe-5e0e-4356-bd77-3b158db75cd7 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:04.748166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c872b06-ddd7-4e77-a056-3e06230e74f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:04.748787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872b06-ddd7-4e77-a056-3e06230e74f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.749076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872b06-ddd7-4e77-a056-3e06230e74f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.749544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872b06-ddd7-4e77-a056-3e06230e74f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.751900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c872b06-ddd7-4e77-a056-3e06230e74f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:04.754506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c872b06-ddd7-4e77-a056-3e06230e74f4 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:04.841449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 802/1582] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:04 2022] POST /identity/v3/projects => generated 387 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:04.842153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8ec6e-9f95-4292-8de3-7eac7ec7716f service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:04.858304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8ec6e-9f95-4292-8de3-7eac7ec7716f service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:04.982437 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8debf-5416-444f-ab50-561ec2f8fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:04.983061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8debf-5416-444f-ab50-561ec2f8fd91 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:04.983377 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8debf-5416-444f-ab50-561ec2f8fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:04.983656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8debf-5416-444f-ab50-561ec2f8fd91 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:04.984318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8debf-5416-444f-ab50-561ec2f8fd91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:04.986283 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8debf-5416-444f-ab50-561ec2f8fd91 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:05.010652 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 781/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:04 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:05.014433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c872b06-ddd7-4e77-a056-3e06230e74f4 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:05.025603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c872b06-ddd7-4e77-a056-3e06230e74f4 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:05.030206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd13be-3f45-496d-ace7-30f6e2bbfb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:05.030938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd13be-3f45-496d-ace7-30f6e2bbfb23 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.031219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd13be-3f45-496d-ace7-30f6e2bbfb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.031595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd13be-3f45-496d-ace7-30f6e2bbfb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.032299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd13be-3f45-496d-ace7-30f6e2bbfb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:05.034758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd13be-3f45-496d-ace7-30f6e2bbfb23 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:05.047208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 803/1584] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:05.051918 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8debf-5416-444f-ab50-561ec2f8fd91 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:05.064846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8debf-5416-444f-ab50-561ec2f8fd91 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:05.072692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd13be-3f45-496d-ace7-30f6e2bbfb23 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:05.075665 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb8e8d-d0f8-433a-bd25-2022bf8ac70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:05.076446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb8e8d-d0f8-433a-bd25-2022bf8ac70d admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.076814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb8e8d-d0f8-433a-bd25-2022bf8ac70d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.077192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb8e8d-d0f8-433a-bd25-2022bf8ac70d admin admin] PATH_INFO: `/v3/projects/cd53c20e2ba941438eaba63ad1810b6c/users/82c81dae715e448f93c5722565f2c424/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.083561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd13be-3f45-496d-ace7-30f6e2bbfb23 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:05.089254 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:05.089892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.090178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.090457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] PATH_INFO: `/v3/users/0bf57a2db8354013b3daa8b79f56c81e` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.091632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf57a2db8354013b3daa8b79f56c81e)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:05.093588 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:05.098879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb8e8d-d0f8-433a-bd25-2022bf8ac70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd53c20e2ba941438eaba63ad1810b6c, user_id=82c81dae715e448f93c5722565f2c424, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:05.101568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb8e8d-d0f8-433a-bd25-2022bf8ac70d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:05.119324 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 782/1585] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:05 2022] PUT /identity/v3/projects/cd53c20e2ba941438eaba63ad1810b6c/users/82c81dae715e448f93c5722565f2c424/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:05.123217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb8e8d-d0f8-433a-bd25-2022bf8ac70d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:05.169675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf57a2db8354013b3daa8b79f56c81e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:05.172634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:05.186049 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf57a2db8354013b3daa8b79f56c81e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:05.187508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf57a2db8354013b3daa8b79f56c81e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:05.188699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf57a2db8354013b3daa8b79f56c81e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:05.203634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf57a2db8354013b3daa8b79f56c81e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:05.206365 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb8e8d-d0f8-433a-bd25-2022bf8ac70d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:05.210838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324a94d-f2db-4f3e-aac5-929f7111eedc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:05.212318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324a94d-f2db-4f3e-aac5-929f7111eedc service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.212705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324a94d-f2db-4f3e-aac5-929f7111eedc service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.213183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324a94d-f2db-4f3e-aac5-929f7111eedc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.215394 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1324a94d-f2db-4f3e-aac5-929f7111eedc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:05.229485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 804/1586] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:05 2022] DELETE /identity/v3/users/0bf57a2db8354013b3daa8b79f56c81e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:05.230184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:05.233393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:05.301098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:05.303060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324a94d-f2db-4f3e-aac5-929f7111eedc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:05.307605 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324a94d-f2db-4f3e-aac5-929f7111eedc service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:05.327829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 783/1587] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:05.329148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099c972-cc29-40b5-af11-f7cccab40157 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.329439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099c972-cc29-40b5-af11-f7cccab40157 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.329720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099c972-cc29-40b5-af11-f7cccab40157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.342416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70355d6-320a-4df7-b190-b244e1ea6cde admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:05.347947 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64231e8-3e5b-42a9-aee9-7c03f6e72007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:05.348836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64231e8-3e5b-42a9-aee9-7c03f6e72007 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.349240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64231e8-3e5b-42a9-aee9-7c03f6e72007 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.349951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64231e8-3e5b-42a9-aee9-7c03f6e72007 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.350364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64231e8-3e5b-42a9-aee9-7c03f6e72007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:05.352235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64231e8-3e5b-42a9-aee9-7c03f6e72007 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:05.357744 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c099c972-cc29-40b5-af11-f7cccab40157 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:05.359554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c099c972-cc29-40b5-af11-f7cccab40157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:05.363828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 805/1588] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:05.368103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64231e8-3e5b-42a9-aee9-7c03f6e72007 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:05.368812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 784/1589] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:05.379685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64231e8-3e5b-42a9-aee9-7c03f6e72007 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:05.386525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485901d-d9db-4247-b050-9e6e4f711955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:05.387470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485901d-d9db-4247-b050-9e6e4f711955 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.387829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485901d-d9db-4247-b050-9e6e4f711955 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.388226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485901d-d9db-4247-b050-9e6e4f711955 admin admin] PATH_INFO: `/v3/projects/cd53c20e2ba941438eaba63ad1810b6c/users/82c81dae715e448f93c5722565f2c424/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.390509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485901d-d9db-4247-b050-9e6e4f711955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd53c20e2ba941438eaba63ad1810b6c, user_id=82c81dae715e448f93c5722565f2c424, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:05.401566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485901d-d9db-4247-b050-9e6e4f711955 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:05.410883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099c972-cc29-40b5-af11-f7cccab40157 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:05.412303 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c099c972-cc29-40b5-af11-f7cccab40157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:05.425776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 806/1590] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:05 2022] PUT /identity/v3/projects/cd53c20e2ba941438eaba63ad1810b6c/users/82c81dae715e448f93c5722565f2c424/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:05.427442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d8c4-4c8d-4601-a350-d69fcea00b5b None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.427727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d8c4-4c8d-4601-a350-d69fcea00b5b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.428007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d8c4-4c8d-4601-a350-d69fcea00b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.488248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-f252d8c4-4c8d-4601-a350-d69fcea00b5b None None] MFA Rules not processed for user `82c81dae715e448f93c5722565f2c424`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:05.489534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f252d8c4-4c8d-4601-a350-d69fcea00b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:05.514059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099c972-cc29-40b5-af11-f7cccab40157 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:05.609437 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06912c-d955-4474-8e25-9002d4f107e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:05.610410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06912c-d955-4474-8e25-9002d4f107e9 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.610410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06912c-d955-4474-8e25-9002d4f107e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.610607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06912c-d955-4474-8e25-9002d4f107e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.621857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 807/1591] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:05.629538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252d8c4-4c8d-4601-a350-d69fcea00b5b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:05.631515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f252d8c4-4c8d-4601-a350-d69fcea00b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:05.667487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:05.693005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06912c-d955-4474-8e25-9002d4f107e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:05.694457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06912c-d955-4474-8e25-9002d4f107e9 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:05.709300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 785/1592] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:05.714374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252d8c4-4c8d-4601-a350-d69fcea00b5b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:05.717869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680de412-37b5-4bfc-a59e-4e785606a49b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:05.718808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680de412-37b5-4bfc-a59e-4e785606a49b service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.718938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680de412-37b5-4bfc-a59e-4e785606a49b service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.719227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680de412-37b5-4bfc-a59e-4e785606a49b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.730494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680de412-37b5-4bfc-a59e-4e785606a49b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:05.732112 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680de412-37b5-4bfc-a59e-4e785606a49b service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:05.756582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 808/1593] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:05.778042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06912c-d955-4474-8e25-9002d4f107e9 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:05.787990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06912c-d955-4474-8e25-9002d4f107e9 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:05.792934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:05.793720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.793858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.794105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] PATH_INFO: `/v3/users/3dd7785c7b7b4ee29dd0862f59577a53` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.795244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd7785c7b7b4ee29dd0862f59577a53)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:05.797278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:05.892277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd7785c7b7b4ee29dd0862f59577a53'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:05.904981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd7785c7b7b4ee29dd0862f59577a53'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:05.905728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd7785c7b7b4ee29dd0862f59577a53'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:05.906376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd7785c7b7b4ee29dd0862f59577a53'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:05.916673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd7785c7b7b4ee29dd0862f59577a53'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:05.951074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 786/1594] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:05 2022] DELETE /identity/v3/users/3dd7785c7b7b4ee29dd0862f59577a53 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:05.953190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d068b-5552-4011-a3f8-a2e472ad738b None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:05.953483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d068b-5552-4011-a3f8-a2e472ad738b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:05.953761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d068b-5552-4011-a3f8-a2e472ad738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:05.973904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-278d068b-5552-4011-a3f8-a2e472ad738b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:05.975119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-278d068b-5552-4011-a3f8-a2e472ad738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:06.036736 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:06.049132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:06.050719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:06.058626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 809/1595] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:06.081696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d068b-5552-4011-a3f8-a2e472ad738b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:06.083734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-278d068b-5552-4011-a3f8-a2e472ad738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:06.084912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b196a4c-61bc-4a8f-9515-3aac8a96985b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:06.090174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:06.090822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:06.091107 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:06.091420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] PATH_INFO: `/v3/projects/c97652698a7240f2a92c264bd45e3620` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:06.092568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97652698a7240f2a92c264bd45e3620)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:06.094484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:06.147658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97652698a7240f2a92c264bd45e3620', 'request_id': 'req-c62efae5-a547-43e3-ad6d-5f7f2590b267'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:06.150871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d068b-5552-4011-a3f8-a2e472ad738b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:06.156168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97652698a7240f2a92c264bd45e3620', 'request_id': 'req-c62efae5-a547-43e3-ad6d-5f7f2590b267'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:06.166755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97652698a7240f2a92c264bd45e3620', 'request_id': 'req-c62efae5-a547-43e3-ad6d-5f7f2590b267'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:06.183777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] The token cache is being invalidate because project c97652698a7240f2a92c264bd45e3620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:06.184074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:06.184808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:06.187125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 787/1596] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:06 2022] DELETE /identity/v3/projects/c97652698a7240f2a92c264bd45e3620 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:06.191910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:06.194168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:06.228366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8715bda-b5e4-4b77-bcc4-a02d51a0e4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:06.228993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8715bda-b5e4-4b77-bcc4-a02d51a0e4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:06.229275 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8715bda-b5e4-4b77-bcc4-a02d51a0e4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:06.229543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8715bda-b5e4-4b77-bcc4-a02d51a0e4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:06.231309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b8715bda-b5e4-4b77-bcc4-a02d51a0e4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:06.249622 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:06.288679 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62efae5-a547-43e3-ad6d-5f7f2590b267 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:06.294866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:06.295796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:06.295908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:06.296097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] PATH_INFO: `/v3/users/46d171d6e4384ab9bc26478cbb15e282` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:06.297622 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d171d6e4384ab9bc26478cbb15e282)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:06.302824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:06.325644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8715bda-b5e4-4b77-bcc4-a02d51a0e4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:06.328120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8715bda-b5e4-4b77-bcc4-a02d51a0e4b4 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:06.346140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 810/1597] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:06.373041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d171d6e4384ab9bc26478cbb15e282'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:06.386861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d171d6e4384ab9bc26478cbb15e282'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:06.389246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d171d6e4384ab9bc26478cbb15e282'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:06.390135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d171d6e4384ab9bc26478cbb15e282'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:06.403128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d171d6e4384ab9bc26478cbb15e282'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:06.432993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 788/1598] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:06 2022] DELETE /identity/v3/users/46d171d6e4384ab9bc26478cbb15e282 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:06.844465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8715bda-b5e4-4b77-bcc4-a02d51a0e4b4 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:06.846002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b8715bda-b5e4-4b77-bcc4-a02d51a0e4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:06.876043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8715bda-b5e4-4b77-bcc4-a02d51a0e4b4 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:06.999889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:07.009347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:07.011720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:07.018440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:07.019479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:07.021800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:07.021949 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] PATH_INFO: `/v3/projects/8ca9ccf3c20b4a2ca50ad3a5b0f23f6e` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:07.024431 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca9ccf3c20b4a2ca50ad3a5b0f23f6e)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:07.026789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:07.047232 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe695196-1dde-4d45-88d8-955e5eefbd93 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:07.057849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:07.059645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:07.060762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:07.060762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] PATH_INFO: `/v3/projects/e3574cd034cf415286f461f10ba78dcc` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:07.061874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3574cd034cf415286f461f10ba78dcc)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:07.066265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:07.118851 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca9ccf3c20b4a2ca50ad3a5b0f23f6e', 'request_id': 'req-bb2af79e-893e-41f2-8264-6830f55bf8c3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.134421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca9ccf3c20b4a2ca50ad3a5b0f23f6e', 'request_id': 'req-bb2af79e-893e-41f2-8264-6830f55bf8c3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.153822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca9ccf3c20b4a2ca50ad3a5b0f23f6e', 'request_id': 'req-bb2af79e-893e-41f2-8264-6830f55bf8c3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.154085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3574cd034cf415286f461f10ba78dcc', 'request_id': 'req-e4557308-ba77-410a-beda-af3f560bf010'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.165259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3574cd034cf415286f461f10ba78dcc', 'request_id': 'req-e4557308-ba77-410a-beda-af3f560bf010'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.168185 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] The token cache is being invalidate because project 8ca9ccf3c20b4a2ca50ad3a5b0f23f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:07.168500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.169246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.171250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 811/1599] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:06 2022] DELETE /identity/v3/projects/8ca9ccf3c20b4a2ca50ad3a5b0f23f6e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:07.175105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:07.175241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3574cd034cf415286f461f10ba78dcc', 'request_id': 'req-e4557308-ba77-410a-beda-af3f560bf010'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.177177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:07.208159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] The token cache is being invalidate because project e3574cd034cf415286f461f10ba78dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:07.208457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.209222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e4557308-ba77-410a-beda-af3f560bf010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.210787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 789/1600] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:07 2022] DELETE /identity/v3/projects/e3574cd034cf415286f461f10ba78dcc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:07.212966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1c81b-1e6c-40c8-a51a-25fc864400db None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:07.213256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1c81b-1e6c-40c8-a51a-25fc864400db None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:07.213574 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1c81b-1e6c-40c8-a51a-25fc864400db None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:07.214963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 790/1601] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:50:07.217990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dc4fc-654b-42e8-a7a7-324a8e661700 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:07.218350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dc4fc-654b-42e8-a7a7-324a8e661700 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:07.218695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dc4fc-654b-42e8-a7a7-324a8e661700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:07.248438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-637dc4fc-654b-42e8-a7a7-324a8e661700 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:07.249661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-637dc4fc-654b-42e8-a7a7-324a8e661700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:07.264759 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af79e-893e-41f2-8264-6830f55bf8c3 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:07.323699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:07.374187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:07.375577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:07.375866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:07.376143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] PATH_INFO: `/v3/users/82c81dae715e448f93c5722565f2c424` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:07.377864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c81dae715e448f93c5722565f2c424)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:07.379878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:07.390116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 791/1602] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:07.391478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b1378-872e-462c-bc9d-82dac0e2ea52 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:07.391758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b1378-872e-462c-bc9d-82dac0e2ea52 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:07.392030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b1378-872e-462c-bc9d-82dac0e2ea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:07.424949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-2f6b1378-872e-462c-bc9d-82dac0e2ea52 None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:07.426191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2f6b1378-872e-462c-bc9d-82dac0e2ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:07.439777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:07.464410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c81dae715e448f93c5722565f2c424'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.474797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c81dae715e448f93c5722565f2c424'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.476291 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c81dae715e448f93c5722565f2c424'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.478363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c81dae715e448f93c5722565f2c424'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.488442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-660c317a-6ace-43b4-a75c-089936f4e410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c81dae715e448f93c5722565f2c424'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:07.524305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 812/1603] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:07 2022] DELETE /identity/v3/users/82c81dae715e448f93c5722565f2c424 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:07.525038 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 792/1604] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:50:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:07.525712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c35a9-aeca-43fc-b541-85b8b8edacb0 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:07.526007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c35a9-aeca-43fc-b541-85b8b8edacb0 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:07.526287 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c35a9-aeca-43fc-b541-85b8b8edacb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:07.552160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-402c35a9-aeca-43fc-b541-85b8b8edacb0 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:07.553424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-402c35a9-aeca-43fc-b541-85b8b8edacb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:07.659427 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 813/1605] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:07.661094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b1378-872e-462c-bc9d-82dac0e2ea52 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:07.677095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b1378-872e-462c-bc9d-82dac0e2ea52 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:07.682690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad3d9d-0ba4-4241-b33a-d4b8b12122e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:07.683400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3d9d-0ba4-4241-b33a-d4b8b12122e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:07.683686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3d9d-0ba4-4241-b33a-d4b8b12122e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:07.684111 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3d9d-0ba4-4241-b33a-d4b8b12122e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:07.684789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad3d9d-0ba4-4241-b33a-d4b8b12122e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:07.685100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad3d9d-0ba4-4241-b33a-d4b8b12122e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:07.687310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad3d9d-0ba4-4241-b33a-d4b8b12122e9 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:07.701513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 793/1606] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:50:07.706017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c35a9-aeca-43fc-b541-85b8b8edacb0 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:07.717094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c35a9-aeca-43fc-b541-85b8b8edacb0 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:07.722787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a815a2-82c6-46a7-851f-b16814ed2293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:07.747345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a815a2-82c6-46a7-851f-b16814ed2293 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:07.747345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a815a2-82c6-46a7-851f-b16814ed2293 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:07.747345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a815a2-82c6-46a7-851f-b16814ed2293 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:07.747345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a815a2-82c6-46a7-851f-b16814ed2293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:07.747345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a815a2-82c6-46a7-851f-b16814ed2293 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:07.757338 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad3d9d-0ba4-4241-b33a-d4b8b12122e9 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:07.759540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fbad3d9d-0ba4-4241-b33a-d4b8b12122e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:07.797142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 814/1607] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:07 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:07.798391 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a815a2-82c6-46a7-851f-b16814ed2293 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:07.876894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad3d9d-0ba4-4241-b33a-d4b8b12122e9 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:07.940488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a815a2-82c6-46a7-851f-b16814ed2293 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:07.947051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c46951-5e73-4b3e-946c-711225fd7eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:07.950016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c46951-5e73-4b3e-946c-711225fd7eea admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:07.950474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c46951-5e73-4b3e-946c-711225fd7eea admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:07.950874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c46951-5e73-4b3e-946c-711225fd7eea admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:07.951588 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c46951-5e73-4b3e-946c-711225fd7eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:07.954202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c46951-5e73-4b3e-946c-711225fd7eea admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:07.955823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:07.983500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 815/1608] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:07 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:07.986904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c46951-5e73-4b3e-946c-711225fd7eea admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:08.005717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c46951-5e73-4b3e-946c-711225fd7eea admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:08.012216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aeeb2-dcf8-4c67-a864-3d230ee24e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:08.013123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aeeb2-dcf8-4c67-a864-3d230ee24e15 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.013604 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aeeb2-dcf8-4c67-a864-3d230ee24e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.014095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aeeb2-dcf8-4c67-a864-3d230ee24e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.014969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aeeb2-dcf8-4c67-a864-3d230ee24e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:08.018123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aeeb2-dcf8-4c67-a864-3d230ee24e15 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:08.020246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1bc7f-e214-419e-966b-5df064440d90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:08.021734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1bc7f-e214-419e-966b-5df064440d90 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.022020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1bc7f-e214-419e-966b-5df064440d90 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.022294 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1bc7f-e214-419e-966b-5df064440d90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.043582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1bc7f-e214-419e-966b-5df064440d90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:08.045624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 816/1609] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:08.049124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1bc7f-e214-419e-966b-5df064440d90 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:08.050652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aeeb2-dcf8-4c67-a864-3d230ee24e15 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:08.064715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 794/1610] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:08.088539 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aeeb2-dcf8-4c67-a864-3d230ee24e15 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:08.101204 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca572e83-d121-40f9-8340-da8afd905b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:08.102353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572e83-d121-40f9-8340-da8afd905b2d admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.102647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572e83-d121-40f9-8340-da8afd905b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.102917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572e83-d121-40f9-8340-da8afd905b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.103598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca572e83-d121-40f9-8340-da8afd905b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:08.105217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca572e83-d121-40f9-8340-da8afd905b2d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:08.106886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:08.119183 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 817/1611] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:08.123867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1bc7f-e214-419e-966b-5df064440d90 service nova] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:08.140099 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1bc7f-e214-419e-966b-5df064440d90 service nova] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:08.140973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca572e83-d121-40f9-8340-da8afd905b2d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:08.144402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ca572e83-d121-40f9-8340-da8afd905b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:08.151270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acd748-6218-454d-9ddb-339dc7224d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:08.152539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acd748-6218-454d-9ddb-339dc7224d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.152837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acd748-6218-454d-9ddb-339dc7224d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.162706 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acd748-6218-454d-9ddb-339dc7224d1c admin admin] PATH_INFO: `/v3/projects/7353b90873414cd88e5ffc29f2134366/users/ebf1164982044762b0be0fc0d625cd81/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.175985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca572e83-d121-40f9-8340-da8afd905b2d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:08.186747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:08.204286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acd748-6218-454d-9ddb-339dc7224d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7353b90873414cd88e5ffc29f2134366, user_id=ebf1164982044762b0be0fc0d625cd81, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:08.204286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acd748-6218-454d-9ddb-339dc7224d1c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:08.204480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.204480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.204480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] PATH_INFO: `/v3/projects/cd53c20e2ba941438eaba63ad1810b6c` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.204480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd53c20e2ba941438eaba63ad1810b6c)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:08.204480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:08.234689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 795/1612] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:08 2022] PUT /identity/v3/projects/7353b90873414cd88e5ffc29f2134366/users/ebf1164982044762b0be0fc0d625cd81/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:08.237208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fad601-fc04-4593-ac23-25ca6fad389f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.237499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fad601-fc04-4593-ac23-25ca6fad389f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.238033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fad601-fc04-4593-ac23-25ca6fad389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.267408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-f4fad601-fc04-4593-ac23-25ca6fad389f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:08.268747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f4fad601-fc04-4593-ac23-25ca6fad389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:08.274214 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd53c20e2ba941438eaba63ad1810b6c', 'request_id': 'req-01039474-d4a6-46c2-bcc2-7725f9d85e72'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:08.284580 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd53c20e2ba941438eaba63ad1810b6c', 'request_id': 'req-01039474-d4a6-46c2-bcc2-7725f9d85e72'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:08.296015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd53c20e2ba941438eaba63ad1810b6c', 'request_id': 'req-01039474-d4a6-46c2-bcc2-7725f9d85e72'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:08.314634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] The token cache is being invalidate because project cd53c20e2ba941438eaba63ad1810b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:08.315205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:08.316268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-01039474-d4a6-46c2-bcc2-7725f9d85e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:08.318282 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 818/1613] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:08 2022] DELETE /identity/v3/projects/cd53c20e2ba941438eaba63ad1810b6c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:08.325823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11fb57-c4f1-4312-8012-b2f9f3ad0899 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.326584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11fb57-c4f1-4312-8012-b2f9f3ad0899 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.327186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11fb57-c4f1-4312-8012-b2f9f3ad0899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.369502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bb11fb57-c4f1-4312-8012-b2f9f3ad0899 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:08.371199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bb11fb57-c4f1-4312-8012-b2f9f3ad0899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:08.453078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 796/1614] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:08.464554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fad601-fc04-4593-ac23-25ca6fad389f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:08.466112 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f4fad601-fc04-4593-ac23-25ca6fad389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:08.525397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 819/1615] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:08.527533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401f84-34e7-487c-ba7b-87e17f177011 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.527829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401f84-34e7-487c-ba7b-87e17f177011 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.528161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa401f84-34e7-487c-ba7b-87e17f177011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.598599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fad601-fc04-4593-ac23-25ca6fad389f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:08.600234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-fa401f84-34e7-487c-ba7b-87e17f177011 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:08.601669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fa401f84-34e7-487c-ba7b-87e17f177011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:08.603439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bc15c-9346-4049-b89c-e9caad0f860f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:08.604465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bc15c-9346-4049-b89c-e9caad0f860f service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.605155 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bc15c-9346-4049-b89c-e9caad0f860f service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.605748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bc15c-9346-4049-b89c-e9caad0f860f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.612909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 820/1616] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:08.618303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa401f84-34e7-487c-ba7b-87e17f177011 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:08.621343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bc15c-9346-4049-b89c-e9caad0f860f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:08.623499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bc15c-9346-4049-b89c-e9caad0f860f service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:08.632498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa401f84-34e7-487c-ba7b-87e17f177011 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:08.636471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 797/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:08.644600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6af03c-4f58-415b-9206-062b9efbc284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:08.646716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6af03c-4f58-415b-9206-062b9efbc284 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.647207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6af03c-4f58-415b-9206-062b9efbc284 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.647640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6af03c-4f58-415b-9206-062b9efbc284 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.649872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6af03c-4f58-415b-9206-062b9efbc284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:08.650356 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6af03c-4f58-415b-9206-062b9efbc284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:08.652427 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6af03c-4f58-415b-9206-062b9efbc284 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:08.687485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 821/1618] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:50:08.691462 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bc15c-9346-4049-b89c-e9caad0f860f service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:08.707342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bc15c-9346-4049-b89c-e9caad0f860f service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:08.715849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe6f69-0869-470b-a78e-ec60e77d032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:08.717401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe6f69-0869-470b-a78e-ec60e77d032e admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.718056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe6f69-0869-470b-a78e-ec60e77d032e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.718630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe6f69-0869-470b-a78e-ec60e77d032e admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.719577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe6f69-0869-470b-a78e-ec60e77d032e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:08.724489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe6f69-0869-470b-a78e-ec60e77d032e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:08.810921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 798/1619] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:08 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:08.815474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6af03c-4f58-415b-9206-062b9efbc284 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:08.831755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6af03c-4f58-415b-9206-062b9efbc284 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:08.970731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a69fa-2610-488a-886e-e1341c8838bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:08.971887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a69fa-2610-488a-886e-e1341c8838bc admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:08.972179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a69fa-2610-488a-886e-e1341c8838bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:08.972543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a69fa-2610-488a-886e-e1341c8838bc admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:08.973090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a69fa-2610-488a-886e-e1341c8838bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:08.975082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a69fa-2610-488a-886e-e1341c8838bc admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:08.987803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:09.015722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 822/1620] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:08 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:09.019681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe6f69-0869-470b-a78e-ec60e77d032e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:09.036738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe6f69-0869-470b-a78e-ec60e77d032e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:09.045749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3ee02-a251-4f21-8cef-65292354c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:09.046870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3ee02-a251-4f21-8cef-65292354c2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:09.047632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3ee02-a251-4f21-8cef-65292354c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:09.048554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3ee02-a251-4f21-8cef-65292354c2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:09.049490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3ee02-a251-4f21-8cef-65292354c2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:09.052401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3ee02-a251-4f21-8cef-65292354c2b1 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:09.105006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 799/1621] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:09.106844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a69fa-2610-488a-886e-e1341c8838bc admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:09.128460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a69fa-2610-488a-886e-e1341c8838bc admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:09.142467 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fc790-300a-45ad-8a3c-dbde7408dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:09.145956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fc790-300a-45ad-8a3c-dbde7408dd6a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:09.146380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fc790-300a-45ad-8a3c-dbde7408dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:09.147093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fc790-300a-45ad-8a3c-dbde7408dd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:09.149008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fc790-300a-45ad-8a3c-dbde7408dd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:09.153939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fc790-300a-45ad-8a3c-dbde7408dd6a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:09.203135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 823/1622] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:09.204408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3ee02-a251-4f21-8cef-65292354c2b1 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:09.223430 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3ee02-a251-4f21-8cef-65292354c2b1 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:09.241363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d29b1d-d015-40a4-83be-2d434e739297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:09.242277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d29b1d-d015-40a4-83be-2d434e739297 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:09.243803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d29b1d-d015-40a4-83be-2d434e739297 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:09.244602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d29b1d-d015-40a4-83be-2d434e739297 admin admin] PATH_INFO: `/v3/projects/4edf3878f798486d9211282752a8dba5/users/522c619dcd4d4365a99cffc2619d9232/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:09.268148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d29b1d-d015-40a4-83be-2d434e739297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edf3878f798486d9211282752a8dba5, user_id=522c619dcd4d4365a99cffc2619d9232, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:09.274229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d29b1d-d015-40a4-83be-2d434e739297 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:09.350449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 800/1623] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:09 2022] PUT /identity/v3/projects/4edf3878f798486d9211282752a8dba5/users/522c619dcd4d4365a99cffc2619d9232/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:09.353078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba03545-27ec-4cf3-adc4-8b9e5e31e023 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:09.353461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba03545-27ec-4cf3-adc4-8b9e5e31e023 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:09.353746 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba03545-27ec-4cf3-adc4-8b9e5e31e023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:09.421389 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-dba03545-27ec-4cf3-adc4-8b9e5e31e023 None None] MFA Rules not processed for user `522c619dcd4d4365a99cffc2619d9232`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:09.425670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-dba03545-27ec-4cf3-adc4-8b9e5e31e023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:09.623097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d29b1d-d015-40a4-83be-2d434e739297 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:09.626158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 824/1624] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:09.629649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:09.666493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba03545-27ec-4cf3-adc4-8b9e5e31e023 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:09.668472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-dba03545-27ec-4cf3-adc4-8b9e5e31e023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:09.744770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d29b1d-d015-40a4-83be-2d434e739297 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:09.751014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b708fb-5956-4ab9-badd-ff89fa2c548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:09.751872 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b708fb-5956-4ab9-badd-ff89fa2c548c admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:09.752330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b708fb-5956-4ab9-badd-ff89fa2c548c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:09.752754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b708fb-5956-4ab9-badd-ff89fa2c548c admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:09.753887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b708fb-5956-4ab9-badd-ff89fa2c548c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:09.756053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b708fb-5956-4ab9-badd-ff89fa2c548c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:09.769033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba03545-27ec-4cf3-adc4-8b9e5e31e023 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:09.776863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:09.778228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:09.778467 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:09.778762 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] PATH_INFO: `/v3/users/30bea6fcfba3431b9f8ae1c3a6cde5dd` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:09.780184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bea6fcfba3431b9f8ae1c3a6cde5dd)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:09.782090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:09.804811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 801/1625] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:09 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:09.806293 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c086-9c48-4a89-a9f7-ca06f9b79d28 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:09.806660 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c086-9c48-4a89-a9f7-ca06f9b79d28 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:09.806951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c086-9c48-4a89-a9f7-ca06f9b79d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:09.849500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0176c086-9c48-4a89-a9f7-ca06f9b79d28 None None] MFA Rules not processed for user `ebf1164982044762b0be0fc0d625cd81`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:09.850896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0176c086-9c48-4a89-a9f7-ca06f9b79d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:09.875063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bea6fcfba3431b9f8ae1c3a6cde5dd'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:09.885913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bea6fcfba3431b9f8ae1c3a6cde5dd'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:09.887217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bea6fcfba3431b9f8ae1c3a6cde5dd'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:09.888110 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bea6fcfba3431b9f8ae1c3a6cde5dd'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:09.904271 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bea6fcfba3431b9f8ae1c3a6cde5dd'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:09.920574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:09.948384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 825/1626] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:09 2022] DELETE /identity/v3/users/30bea6fcfba3431b9f8ae1c3a6cde5dd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:09.951567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:09.951567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:09.958871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 802/1627] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:09.960069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6642473-9343-438e-84dc-037453769498 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:09.960363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6642473-9343-438e-84dc-037453769498 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:09.960644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6642473-9343-438e-84dc-037453769498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:09.985285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b6642473-9343-438e-84dc-037453769498 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:09.986772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b6642473-9343-438e-84dc-037453769498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:10.035237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89763ce8-d6b9-4d1c-be84-99f5eceb7586 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.040842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7e10c-d786-4afa-a553-18e6474bd88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.041462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7e10c-d786-4afa-a553-18e6474bd88a admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.041743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7e10c-d786-4afa-a553-18e6474bd88a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.042020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7e10c-d786-4afa-a553-18e6474bd88a admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.042648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7e10c-d786-4afa-a553-18e6474bd88a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.044634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7e10c-d786-4afa-a553-18e6474bd88a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.056394 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 803/1628] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:10.057237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6642473-9343-438e-84dc-037453769498 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.058757 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b6642473-9343-438e-84dc-037453769498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:10.068365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 826/1629] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:09 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:10.069783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7e10c-d786-4afa-a553-18e6474bd88a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.074470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6642473-9343-438e-84dc-037453769498 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.075571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-38a7e10c-d786-4afa-a553-18e6474bd88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:10.079422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b684-b442-4b50-8d58-a3e940e38da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.080056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b684-b442-4b50-8d58-a3e940e38da4 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.080441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b684-b442-4b50-8d58-a3e940e38da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.080747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b684-b442-4b50-8d58-a3e940e38da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.081513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25b684-b442-4b50-8d58-a3e940e38da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.083723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25b684-b442-4b50-8d58-a3e940e38da4 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.102777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:10.121480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 804/1630] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:10 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:10.121480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b684-b442-4b50-8d58-a3e940e38da4 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.140194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7e10c-d786-4afa-a553-18e6474bd88a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.188392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b684-b442-4b50-8d58-a3e940e38da4 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.193395 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a799c1e-e4b6-49a7-9764-ffe627955f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.193931 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846293fe-6e9f-4701-975c-1dc7f1ad580b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.194089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a799c1e-e4b6-49a7-9764-ffe627955f07 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.194546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a799c1e-e4b6-49a7-9764-ffe627955f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.195113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a799c1e-e4b6-49a7-9764-ffe627955f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.195978 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a799c1e-e4b6-49a7-9764-ffe627955f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.197015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846293fe-6e9f-4701-975c-1dc7f1ad580b service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.197706 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a799c1e-e4b6-49a7-9764-ffe627955f07 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.199466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846293fe-6e9f-4701-975c-1dc7f1ad580b service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.199749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846293fe-6e9f-4701-975c-1dc7f1ad580b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.209874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 805/1631] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:10.210816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a799c1e-e4b6-49a7-9764-ffe627955f07 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.222508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846293fe-6e9f-4701-975c-1dc7f1ad580b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.227874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a799c1e-e4b6-49a7-9764-ffe627955f07 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.230811 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846293fe-6e9f-4701-975c-1dc7f1ad580b service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.245701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100b49-20db-4931-835b-7efc3e75ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.246386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100b49-20db-4931-835b-7efc3e75ff47 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.246597 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100b49-20db-4931-835b-7efc3e75ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.247036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100b49-20db-4931-835b-7efc3e75ff47 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.247789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9100b49-20db-4931-835b-7efc3e75ff47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.250851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9100b49-20db-4931-835b-7efc3e75ff47 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.273428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 827/1632] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:10.283013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846293fe-6e9f-4701-975c-1dc7f1ad580b service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.305538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 806/1633] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:10 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:10.311861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100b49-20db-4931-835b-7efc3e75ff47 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.313224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846293fe-6e9f-4701-975c-1dc7f1ad580b service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.318326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77e59f-3140-4a75-ad0a-51f397d538ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.319033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e59f-3140-4a75-ad0a-51f397d538ca admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.319531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e59f-3140-4a75-ad0a-51f397d538ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.319717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77e59f-3140-4a75-ad0a-51f397d538ca admin admin] PATH_INFO: `/v3/projects/3cef3cb8006f4bbb835e2dcf5c11b59b/users/888bd8cb094c4e82a5c9b1fdf8e17694/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.338873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77e59f-3140-4a75-ad0a-51f397d538ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cef3cb8006f4bbb835e2dcf5c11b59b, user_id=888bd8cb094c4e82a5c9b1fdf8e17694, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.339441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100b49-20db-4931-835b-7efc3e75ff47 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.341927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77e59f-3140-4a75-ad0a-51f397d538ca admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.346637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967cd21-ae50-4c87-837c-0f831dbdc588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.347617 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967cd21-ae50-4c87-837c-0f831dbdc588 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.348071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967cd21-ae50-4c87-837c-0f831dbdc588 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.348567 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967cd21-ae50-4c87-837c-0f831dbdc588 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.349751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967cd21-ae50-4c87-837c-0f831dbdc588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.353598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967cd21-ae50-4c87-837c-0f831dbdc588 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.359198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 828/1634] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:10 2022] PUT /identity/v3/projects/3cef3cb8006f4bbb835e2dcf5c11b59b/users/888bd8cb094c4e82a5c9b1fdf8e17694/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:10.364621 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77e59f-3140-4a75-ad0a-51f397d538ca admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.370188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 807/1635] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:10.374659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967cd21-ae50-4c87-837c-0f831dbdc588 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.397270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:10.402934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967cd21-ae50-4c87-837c-0f831dbdc588 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.529372 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77e59f-3140-4a75-ad0a-51f397d538ca admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.548221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5ebf2-a098-490e-be3a-6cc4f06d2e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.549685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5ebf2-a098-490e-be3a-6cc4f06d2e15 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.550845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5ebf2-a098-490e-be3a-6cc4f06d2e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.551196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5ebf2-a098-490e-be3a-6cc4f06d2e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.551954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5ebf2-a098-490e-be3a-6cc4f06d2e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.554157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5ebf2-a098-490e-be3a-6cc4f06d2e15 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.556027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932374-7beb-4a76-9f40-4479f82d7154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.556924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932374-7beb-4a76-9f40-4479f82d7154 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.557413 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932374-7beb-4a76-9f40-4479f82d7154 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.557873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19932374-7beb-4a76-9f40-4479f82d7154 admin admin] PATH_INFO: `/v3/projects/a24e6d09a92f4695815486eee000c197/users/5703297327d04c2797cd9609feca3ad7/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.580402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 829/1636] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:10.582017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5ebf2-a098-490e-be3a-6cc4f06d2e15 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.584384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19932374-7beb-4a76-9f40-4479f82d7154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24e6d09a92f4695815486eee000c197, user_id=5703297327d04c2797cd9609feca3ad7, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.587388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19932374-7beb-4a76-9f40-4479f82d7154 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.599935 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5ebf2-a098-490e-be3a-6cc4f06d2e15 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.607863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 808/1637] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:10 2022] PUT /identity/v3/projects/a24e6d09a92f4695815486eee000c197/users/5703297327d04c2797cd9609feca3ad7/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:10.609273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932374-7beb-4a76-9f40-4479f82d7154 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.677135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:10.723626 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19932374-7beb-4a76-9f40-4479f82d7154 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.730824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a38f51-7b3c-4a77-b1ba-182d0fd99569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.731519 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a38f51-7b3c-4a77-b1ba-182d0fd99569 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.731834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a38f51-7b3c-4a77-b1ba-182d0fd99569 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.732194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a38f51-7b3c-4a77-b1ba-182d0fd99569 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.732852 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a38f51-7b3c-4a77-b1ba-182d0fd99569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.734569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a38f51-7b3c-4a77-b1ba-182d0fd99569 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.750181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 809/1638] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:10.754516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a38f51-7b3c-4a77-b1ba-182d0fd99569 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.757270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d5b6b-54f8-44e2-860e-204ed7991031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.757998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5b6b-54f8-44e2-860e-204ed7991031 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.763930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5b6b-54f8-44e2-860e-204ed7991031 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.764196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5b6b-54f8-44e2-860e-204ed7991031 admin admin] PATH_INFO: `/v3/projects/3cef3cb8006f4bbb835e2dcf5c11b59b/users/888bd8cb094c4e82a5c9b1fdf8e17694/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.770558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d5b6b-54f8-44e2-860e-204ed7991031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cef3cb8006f4bbb835e2dcf5c11b59b, user_id=888bd8cb094c4e82a5c9b1fdf8e17694, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.774518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d5b6b-54f8-44e2-860e-204ed7991031 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.782963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a38f51-7b3c-4a77-b1ba-182d0fd99569 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:10.795597 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a313cf-1544-4037-a87e-2f69b49eb665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:10.798095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a313cf-1544-4037-a87e-2f69b49eb665 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.800033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a313cf-1544-4037-a87e-2f69b49eb665 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.800533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a313cf-1544-4037-a87e-2f69b49eb665 admin admin] PATH_INFO: `/v3/projects/a24e6d09a92f4695815486eee000c197/users/5703297327d04c2797cd9609feca3ad7/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.809294 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 830/1639] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:10 2022] PUT /identity/v3/projects/3cef3cb8006f4bbb835e2dcf5c11b59b/users/888bd8cb094c4e82a5c9b1fdf8e17694/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:10.811058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd6e23-86ad-424d-97ed-6e74ef88f0b7 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:10.811442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd6e23-86ad-424d-97ed-6e74ef88f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:10.811723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd6e23-86ad-424d-97ed-6e74ef88f0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:10.816583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a313cf-1544-4037-a87e-2f69b49eb665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24e6d09a92f4695815486eee000c197, user_id=5703297327d04c2797cd9609feca3ad7, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:10.823917 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a313cf-1544-4037-a87e-2f69b49eb665 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:10.847204 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 810/1640] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:10 2022] PUT /identity/v3/projects/a24e6d09a92f4695815486eee000c197/users/5703297327d04c2797cd9609feca3ad7/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:10.855700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-0ecd6e23-86ad-424d-97ed-6e74ef88f0b7 None None] MFA Rules not processed for user `888bd8cb094c4e82a5c9b1fdf8e17694`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:10.856653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0ecd6e23-86ad-424d-97ed-6e74ef88f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:10.873459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a313cf-1544-4037-a87e-2f69b49eb665 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.875215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-96a313cf-1544-4037-a87e-2f69b49eb665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:10.980096 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 831/1641] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:10.992067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd6e23-86ad-424d-97ed-6e74ef88f0b7 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:10.994823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0ecd6e23-86ad-424d-97ed-6e74ef88f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:11.002679 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a313cf-1544-4037-a87e-2f69b49eb665 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:11.009124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:11.010161 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:11.010632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:11.010915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] PATH_INFO: `/v3/projects/ce5fd36280a94c32aaa485d9a6cae046` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:11.012095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5fd36280a94c32aaa485d9a6cae046)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:11.014013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:11.045031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:11.083737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5fd36280a94c32aaa485d9a6cae046', 'request_id': 'req-debe1306-7a0e-412e-8634-b119faf30015'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.094447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd6e23-86ad-424d-97ed-6e74ef88f0b7 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:11.096883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5fd36280a94c32aaa485d9a6cae046', 'request_id': 'req-debe1306-7a0e-412e-8634-b119faf30015'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.107695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5fd36280a94c32aaa485d9a6cae046', 'request_id': 'req-debe1306-7a0e-412e-8634-b119faf30015'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.119967 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] The token cache is being invalidate because project ce5fd36280a94c32aaa485d9a6cae046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:11.120261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.120944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.122826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 811/1642] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:10 2022] DELETE /identity/v3/projects/ce5fd36280a94c32aaa485d9a6cae046 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:11.127060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:11.128517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:11.191620 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c256f3-bf49-430f-bc59-b2ae0af75e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:11.193066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c256f3-bf49-430f-bc59-b2ae0af75e28 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:11.193410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c256f3-bf49-430f-bc59-b2ae0af75e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:11.194494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c256f3-bf49-430f-bc59-b2ae0af75e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:11.199520 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c5c256f3-bf49-430f-bc59-b2ae0af75e28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:11.247379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe1306-7a0e-412e-8634-b119faf30015 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:11.254198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:11.254947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:11.255262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:11.255637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] PATH_INFO: `/v3/users/d529a1c717594d4bb83fbac8faf3a63e` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:11.257059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d529a1c717594d4bb83fbac8faf3a63e)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:11.259878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:11.265145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:11.350968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c256f3-bf49-430f-bc59-b2ae0af75e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:11.353948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c256f3-bf49-430f-bc59-b2ae0af75e28 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:11.356211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd529a1c717594d4bb83fbac8faf3a63e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.366159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd529a1c717594d4bb83fbac8faf3a63e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.366879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd529a1c717594d4bb83fbac8faf3a63e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.367630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd529a1c717594d4bb83fbac8faf3a63e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.369187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 832/1643] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:11.376374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b6248344-9a3c-4831-8a6d-531e4dbca2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd529a1c717594d4bb83fbac8faf3a63e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.401642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 812/1644] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:11 2022] DELETE /identity/v3/users/d529a1c717594d4bb83fbac8faf3a63e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:11.535439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c256f3-bf49-430f-bc59-b2ae0af75e28 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:11.537086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c5c256f3-bf49-430f-bc59-b2ae0af75e28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:11.553991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c256f3-bf49-430f-bc59-b2ae0af75e28 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:11.624612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:11.625954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:11.625954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:11.626176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] PATH_INFO: `/v3/users/522c619dcd4d4365a99cffc2619d9232` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:11.627302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522c619dcd4d4365a99cffc2619d9232)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:11.629258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:11.695303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:11.734245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522c619dcd4d4365a99cffc2619d9232'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.754705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522c619dcd4d4365a99cffc2619d9232'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.755612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522c619dcd4d4365a99cffc2619d9232'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.756348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522c619dcd4d4365a99cffc2619d9232'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.769624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522c619dcd4d4365a99cffc2619d9232'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:11.790460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 833/1645] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:11 2022] DELETE /identity/v3/users/522c619dcd4d4365a99cffc2619d9232 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:11.795187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82e3bb-a41f-450f-9358-ea115633868c None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:11.795677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82e3bb-a41f-450f-9358-ea115633868c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:11.795830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82e3bb-a41f-450f-9358-ea115633868c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:11.823949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0b82e3bb-a41f-450f-9358-ea115633868c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:11.827215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0b82e3bb-a41f-450f-9358-ea115633868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:11.947013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 813/1646] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:11.957232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:11.960401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.003754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82e3bb-a41f-450f-9358-ea115633868c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:12.005740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0b82e3bb-a41f-450f-9358-ea115633868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.035122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82e3bb-a41f-450f-9358-ea115633868c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:12.052051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:12.052816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.053288 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.053734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] PATH_INFO: `/v3/projects/83cfc4212bf348ebb417d2eb4a15a08c` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.054959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cfc4212bf348ebb417d2eb4a15a08c)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:12.057202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:12.061829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f7a97-a08c-4b4c-b527-af7524991d98 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:12.066446 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bdcf0-76b5-4e60-892b-23d0c7e1a0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:12.067417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bdcf0-76b5-4e60-892b-23d0c7e1a0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.067718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bdcf0-76b5-4e60-892b-23d0c7e1a0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.068063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bdcf0-76b5-4e60-892b-23d0c7e1a0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.082928 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bdcf0-76b5-4e60-892b-23d0c7e1a0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:12.084645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bdcf0-76b5-4e60-892b-23d0c7e1a0d9 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:12.100248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 834/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:12.101598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64e54-847a-46f1-b2cf-71423d45d8f5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.102406 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64e54-847a-46f1-b2cf-71423d45d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.102685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64e54-847a-46f1-b2cf-71423d45d8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.149393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cfc4212bf348ebb417d2eb4a15a08c', 'request_id': 'req-f5cf45c6-0f1c-4938-87d1-1527da091b71'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.158440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cfc4212bf348ebb417d2eb4a15a08c', 'request_id': 'req-f5cf45c6-0f1c-4938-87d1-1527da091b71'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.160515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d4d64e54-847a-46f1-b2cf-71423d45d8f5 None None] MFA Rules not processed for user `5703297327d04c2797cd9609feca3ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:12.163267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d4d64e54-847a-46f1-b2cf-71423d45d8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.170736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cfc4212bf348ebb417d2eb4a15a08c', 'request_id': 'req-f5cf45c6-0f1c-4938-87d1-1527da091b71'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.202006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] The token cache is being invalidate because project 83cfc4212bf348ebb417d2eb4a15a08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:12.202006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.203135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5cf45c6-0f1c-4938-87d1-1527da091b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.205906 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 814/1648] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:12 2022] DELETE /identity/v3/projects/83cfc4212bf348ebb417d2eb4a15a08c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:12.212038 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177ce8-0062-4c46-afbd-c970194e428f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.212416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177ce8-0062-4c46-afbd-c970194e428f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.212776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177ce8-0062-4c46-afbd-c970194e428f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.230950 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:12.258361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-60177ce8-0062-4c46-afbd-c970194e428f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:12.259752 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-60177ce8-0062-4c46-afbd-c970194e428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.346597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 835/1649] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:12.358641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f23e8-98d4-4c8f-8a68-cac0ec939a77 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.359034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f23e8-98d4-4c8f-8a68-cac0ec939a77 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.359473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f23e8-98d4-4c8f-8a68-cac0ec939a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.390280 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-3d9f23e8-98d4-4c8f-8a68-cac0ec939a77 None None] MFA Rules not processed for user `ebf1164982044762b0be0fc0d625cd81`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:12.399529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3d9f23e8-98d4-4c8f-8a68-cac0ec939a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.434375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 815/1650] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:12.442898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ca09-1d1f-46b6-9cf3-d106273043da None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.443211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ca09-1d1f-46b6-9cf3-d106273043da None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.443507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ca09-1d1f-46b6-9cf3-d106273043da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.461919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:12.485655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-20a5ca09-1d1f-46b6-9cf3-d106273043da None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:12.487544 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-20a5ca09-1d1f-46b6-9cf3-d106273043da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.507116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 816/1651] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:12.509166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5ca09-1d1f-46b6-9cf3-d106273043da None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:12.511880 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 836/1652] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:12.525933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5ca09-1d1f-46b6-9cf3-d106273043da None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:12.531867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c732374-5dfd-47c1-ad41-e7c112eaaf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:12.532671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c732374-5dfd-47c1-ad41-e7c112eaaf6a admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.534316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c732374-5dfd-47c1-ad41-e7c112eaaf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.534703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c732374-5dfd-47c1-ad41-e7c112eaaf6a admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.535501 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c732374-5dfd-47c1-ad41-e7c112eaaf6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:12.535908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c732374-5dfd-47c1-ad41-e7c112eaaf6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:12.540041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c732374-5dfd-47c1-ad41-e7c112eaaf6a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:12.553143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 817/1653] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:50:12.557888 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f23e8-98d4-4c8f-8a68-cac0ec939a77 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:12.569783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f23e8-98d4-4c8f-8a68-cac0ec939a77 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:12.577411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c06857-eb36-412d-a1b3-ae0650615653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:12.578316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c06857-eb36-412d-a1b3-ae0650615653 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.578621 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c06857-eb36-412d-a1b3-ae0650615653 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.581182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c06857-eb36-412d-a1b3-ae0650615653 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.581504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c06857-eb36-412d-a1b3-ae0650615653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:12.583901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c06857-eb36-412d-a1b3-ae0650615653 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:12.608575 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c732374-5dfd-47c1-ad41-e7c112eaaf6a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:12.610942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1c732374-5dfd-47c1-ad41-e7c112eaaf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.641859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c732374-5dfd-47c1-ad41-e7c112eaaf6a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:12.649144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 837/1654] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:12 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:12.651894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:12.652069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.652285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.652570 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] PATH_INFO: `/v3/projects/4edf3878f798486d9211282752a8dba5` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.653318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c06857-eb36-412d-a1b3-ae0650615653 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:12.656348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edf3878f798486d9211282752a8dba5)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:12.659561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:12.725204 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edf3878f798486d9211282752a8dba5', 'request_id': 'req-2f1602e5-da0a-4afe-aaf7-6004f018dd87'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.732945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c06857-eb36-412d-a1b3-ae0650615653 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:12.733598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edf3878f798486d9211282752a8dba5', 'request_id': 'req-2f1602e5-da0a-4afe-aaf7-6004f018dd87'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.742544 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edf3878f798486d9211282752a8dba5', 'request_id': 'req-2f1602e5-da0a-4afe-aaf7-6004f018dd87'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.755054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] The token cache is being invalidate because project 4edf3878f798486d9211282752a8dba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:12.755426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.756045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.758987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 818/1655] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:12 2022] DELETE /identity/v3/projects/4edf3878f798486d9211282752a8dba5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:12.763581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:12.764977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.801065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a70e3-736b-48c1-931f-b3e6905adbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:12.801685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a70e3-736b-48c1-931f-b3e6905adbae admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.801968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a70e3-736b-48c1-931f-b3e6905adbae admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.802245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a70e3-736b-48c1-931f-b3e6905adbae admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.802925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a70e3-736b-48c1-931f-b3e6905adbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:12.805883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a70e3-736b-48c1-931f-b3e6905adbae admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:12.839322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 838/1656] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:12 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:12.840246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a70e3-736b-48c1-931f-b3e6905adbae admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:12.842472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e13a70e3-736b-48c1-931f-b3e6905adbae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.850757 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:12.856848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1602e5-da0a-4afe-aaf7-6004f018dd87 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:12.857671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a70e3-736b-48c1-931f-b3e6905adbae admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:12.864625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:12.865367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c785d-eaef-4fb9-9ce5-bfc4169171df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:12.865972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.866436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c785d-eaef-4fb9-9ce5-bfc4169171df service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:12.866599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.867010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] PATH_INFO: `/v3/users/888bd8cb094c4e82a5c9b1fdf8e17694` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.867121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c785d-eaef-4fb9-9ce5-bfc4169171df service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:12.867583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c785d-eaef-4fb9-9ce5-bfc4169171df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:12.868863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] RBAC: Authorizing `identity:delete_user(user_id=888bd8cb094c4e82a5c9b1fdf8e17694)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:12.870039 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-cb7c785d-eaef-4fb9-9ce5-bfc4169171df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.871578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:12.947043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888bd8cb094c4e82a5c9b1fdf8e17694'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.948057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c785d-eaef-4fb9-9ce5-bfc4169171df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:12.951875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c785d-eaef-4fb9-9ce5-bfc4169171df service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:12.954269 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:12.958384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888bd8cb094c4e82a5c9b1fdf8e17694'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.960331 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888bd8cb094c4e82a5c9b1fdf8e17694'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.961631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888bd8cb094c4e82a5c9b1fdf8e17694'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:12.970122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 819/1657] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:12.971480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c785d-eaef-4fb9-9ce5-bfc4169171df service nova] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:12.974058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-cb7c785d-eaef-4fb9-9ce5-bfc4169171df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:12.988932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888bd8cb094c4e82a5c9b1fdf8e17694'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:13.000985 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c785d-eaef-4fb9-9ce5-bfc4169171df service nova] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:13.006424 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4f31-4616-46cb-b196-49c6cbb3ac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:13.007044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4f31-4616-46cb-b196-49c6cbb3ac55 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:13.007442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4f31-4616-46cb-b196-49c6cbb3ac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:13.007725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4f31-4616-46cb-b196-49c6cbb3ac55 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:13.008627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a4f31-4616-46cb-b196-49c6cbb3ac55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:13.011061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a4f31-4616-46cb-b196-49c6cbb3ac55 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:13.024600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 820/1658] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:13.027931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4f31-4616-46cb-b196-49c6cbb3ac55 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:13.030028 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-cb1a4f31-4616-46cb-b196-49c6cbb3ac55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:13.035740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 839/1659] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:12 2022] DELETE /identity/v3/users/888bd8cb094c4e82a5c9b1fdf8e17694 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:13.049464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4f31-4616-46cb-b196-49c6cbb3ac55 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:13.129505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cad52c-d462-4b7d-af13-ffd6b2bcc2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:13.130303 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cad52c-d462-4b7d-af13-ffd6b2bcc2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:13.130685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cad52c-d462-4b7d-af13-ffd6b2bcc2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:13.130965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cad52c-d462-4b7d-af13-ffd6b2bcc2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:13.131953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cad52c-d462-4b7d-af13-ffd6b2bcc2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:13.135368 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cad52c-d462-4b7d-af13-ffd6b2bcc2a3 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:13.150011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 821/1660] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:13.154139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:13.165986 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411f3ea-e170-4cb1-8363-a7d79fea48db admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:13.172878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651aeb-3c6f-4cb7-a54c-678ed05eead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:13.174461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651aeb-3c6f-4cb7-a54c-678ed05eead8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:13.174461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651aeb-3c6f-4cb7-a54c-678ed05eead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:13.174823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6651aeb-3c6f-4cb7-a54c-678ed05eead8 admin admin] PATH_INFO: `/v3/projects/3e017d0394b34dcc8fe9c46e62b1afb5/users/d23a870739e94533b7964f796964dc53/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:13.224869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6651aeb-3c6f-4cb7-a54c-678ed05eead8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e017d0394b34dcc8fe9c46e62b1afb5, user_id=d23a870739e94533b7964f796964dc53, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:13.228742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6651aeb-3c6f-4cb7-a54c-678ed05eead8 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:13.275341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 840/1661] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:13 2022] PUT /identity/v3/projects/3e017d0394b34dcc8fe9c46e62b1afb5/users/d23a870739e94533b7964f796964dc53/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:13.281054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1382b6-a1ad-47f9-9038-be6654c5428b None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:13.281054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1382b6-a1ad-47f9-9038-be6654c5428b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:13.281054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1382b6-a1ad-47f9-9038-be6654c5428b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:13.333782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-9c1382b6-a1ad-47f9-9038-be6654c5428b None None] MFA Rules not processed for user `d23a870739e94533b7964f796964dc53`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:13.335742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9c1382b6-a1ad-47f9-9038-be6654c5428b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:13.434493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 822/1662] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:13.440651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651aeb-3c6f-4cb7-a54c-678ed05eead8 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:13.565138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6651aeb-3c6f-4cb7-a54c-678ed05eead8 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:13.571210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413d152-74cc-4a63-9959-0b660a4c28bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:13.571842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413d152-74cc-4a63-9959-0b660a4c28bc admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:13.572249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413d152-74cc-4a63-9959-0b660a4c28bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:13.572678 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413d152-74cc-4a63-9959-0b660a4c28bc admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:13.579365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413d152-74cc-4a63-9959-0b660a4c28bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:13.579365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413d152-74cc-4a63-9959-0b660a4c28bc admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:13.615605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 841/1663] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:13 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:13.620434 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1382b6-a1ad-47f9-9038-be6654c5428b None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:13.636218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1382b6-a1ad-47f9-9038-be6654c5428b None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:13.655818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:13.719040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f16602-250a-471d-a851-b407e0797a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:13.720402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f16602-250a-471d-a851-b407e0797a3b admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:13.720697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f16602-250a-471d-a851-b407e0797a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:13.720979 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f16602-250a-471d-a851-b407e0797a3b admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:13.721633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f16602-250a-471d-a851-b407e0797a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:13.723713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f16602-250a-471d-a851-b407e0797a3b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:13.752799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 823/1664] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:13 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:13.754585 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413d152-74cc-4a63-9959-0b660a4c28bc admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:13.770487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413d152-74cc-4a63-9959-0b660a4c28bc admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:13.778220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d5dbc-f823-499c-a560-2d2086cb5a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:13.779100 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d5dbc-f823-499c-a560-2d2086cb5a5d admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:13.779489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d5dbc-f823-499c-a560-2d2086cb5a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:13.779920 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d5dbc-f823-499c-a560-2d2086cb5a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:13.781240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d5dbc-f823-499c-a560-2d2086cb5a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:13.783032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d5dbc-f823-499c-a560-2d2086cb5a5d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:13.801570 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f16602-250a-471d-a851-b407e0797a3b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:13.808224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 842/1665] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:13.817607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f16602-250a-471d-a851-b407e0797a3b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:13.834010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b3b37-f07a-43fe-9025-1c95b6a81125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:13.835273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b3b37-f07a-43fe-9025-1c95b6a81125 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:13.835596 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b3b37-f07a-43fe-9025-1c95b6a81125 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:13.836687 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b3b37-f07a-43fe-9025-1c95b6a81125 admin admin] PATH_INFO: `/v3/projects/35aedae4e67449d997f420439e7119a1/users/13c2094b3adc449b97bd071cc6d6289e/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:13.855628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d5dbc-f823-499c-a560-2d2086cb5a5d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:13.858799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4c4d5dbc-f823-499c-a560-2d2086cb5a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:13.877637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b3b37-f07a-43fe-9025-1c95b6a81125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35aedae4e67449d997f420439e7119a1, user_id=13c2094b3adc449b97bd071cc6d6289e, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:13.878125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d5dbc-f823-499c-a560-2d2086cb5a5d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:13.882868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b3b37-f07a-43fe-9025-1c95b6a81125 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:13.896740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:13.896740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:13.896740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:13.896740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] PATH_INFO: `/v3/projects/3cef3cb8006f4bbb835e2dcf5c11b59b` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:13.897102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cef3cb8006f4bbb835e2dcf5c11b59b)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:13.897102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:13.917809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 824/1666] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:13 2022] PUT /identity/v3/projects/35aedae4e67449d997f420439e7119a1/users/13c2094b3adc449b97bd071cc6d6289e/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:13.922666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b3b37-f07a-43fe-9025-1c95b6a81125 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:13.969092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cef3cb8006f4bbb835e2dcf5c11b59b', 'request_id': 'req-5c35ce68-a3d1-4b12-b707-5410e932392c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:13.980307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cef3cb8006f4bbb835e2dcf5c11b59b', 'request_id': 'req-5c35ce68-a3d1-4b12-b707-5410e932392c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:13.995220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cef3cb8006f4bbb835e2dcf5c11b59b', 'request_id': 'req-5c35ce68-a3d1-4b12-b707-5410e932392c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:14.010744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] The token cache is being invalidate because project 3cef3cb8006f4bbb835e2dcf5c11b59b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:14.011563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:14.013039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5c35ce68-a3d1-4b12-b707-5410e932392c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:14.016479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 843/1667] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:13 2022] DELETE /identity/v3/projects/3cef3cb8006f4bbb835e2dcf5c11b59b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:14.021047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029989-7e35-45d2-8897-876fe9979665 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.024889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029989-7e35-45d2-8897-876fe9979665 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.025427 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029989-7e35-45d2-8897-876fe9979665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.037864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:14.042115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b3b37-f07a-43fe-9025-1c95b6a81125 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:14.072842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-34029989-7e35-45d2-8897-876fe9979665 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:14.074368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-34029989-7e35-45d2-8897-876fe9979665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:14.117037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379b35a-9799-4e5e-813c-4ccdf330576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:14.117806 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379b35a-9799-4e5e-813c-4ccdf330576b admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.118098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379b35a-9799-4e5e-813c-4ccdf330576b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.118370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379b35a-9799-4e5e-813c-4ccdf330576b admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.119020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379b35a-9799-4e5e-813c-4ccdf330576b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:14.121744 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379b35a-9799-4e5e-813c-4ccdf330576b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:14.138218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 825/1668] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:14.140649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379b35a-9799-4e5e-813c-4ccdf330576b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:14.145778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5379b35a-9799-4e5e-813c-4ccdf330576b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:14.183577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379b35a-9799-4e5e-813c-4ccdf330576b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:14.189174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae0ba8-24be-4c2c-8228-91d8343da2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:14.190449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae0ba8-24be-4c2c-8228-91d8343da2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.190776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae0ba8-24be-4c2c-8228-91d8343da2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.190998 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae0ba8-24be-4c2c-8228-91d8343da2fc admin admin] PATH_INFO: `/v3/projects/35aedae4e67449d997f420439e7119a1/users/13c2094b3adc449b97bd071cc6d6289e/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.193169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae0ba8-24be-4c2c-8228-91d8343da2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=35aedae4e67449d997f420439e7119a1, user_id=13c2094b3adc449b97bd071cc6d6289e, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:14.203067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae0ba8-24be-4c2c-8228-91d8343da2fc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:14.225561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 826/1669] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:14 2022] PUT /identity/v3/projects/35aedae4e67449d997f420439e7119a1/users/13c2094b3adc449b97bd071cc6d6289e/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:14.225756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 844/1670] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:14.226540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06580378-782c-455e-9d0b-f1c0173929af None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.228218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b42b8d-f95e-4be7-8da3-71a77f1b21f1 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.228826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06580378-782c-455e-9d0b-f1c0173929af None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.229050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b42b8d-f95e-4be7-8da3-71a77f1b21f1 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.229344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b42b8d-f95e-4be7-8da3-71a77f1b21f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.231574 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06580378-782c-455e-9d0b-f1c0173929af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.254146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-06580378-782c-455e-9d0b-f1c0173929af None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:14.255422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-06580378-782c-455e-9d0b-f1c0173929af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:14.259965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-65b42b8d-f95e-4be7-8da3-71a77f1b21f1 None None] MFA Rules not processed for user `13c2094b3adc449b97bd071cc6d6289e`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:14.261160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-65b42b8d-f95e-4be7-8da3-71a77f1b21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:14.266838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:14.345276 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 827/1671] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:14.354637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06580378-782c-455e-9d0b-f1c0173929af None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:14.363363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 845/1672] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:14.369880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06580378-782c-455e-9d0b-f1c0173929af None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:14.376724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b42b8d-f95e-4be7-8da3-71a77f1b21f1 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:14.378282 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-65b42b8d-f95e-4be7-8da3-71a77f1b21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:14.379513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f6a8-004b-4c52-a202-568e60c09f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:14.380689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f6a8-004b-4c52-a202-568e60c09f5a admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.381128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f6a8-004b-4c52-a202-568e60c09f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.381582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f6a8-004b-4c52-a202-568e60c09f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.382259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21f6a8-004b-4c52-a202-568e60c09f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:14.382572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21f6a8-004b-4c52-a202-568e60c09f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:14.384824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21f6a8-004b-4c52-a202-568e60c09f5a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:14.402387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 828/1673] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:50:14.403512 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f6a8-004b-4c52-a202-568e60c09f5a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:14.419607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f6a8-004b-4c52-a202-568e60c09f5a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:14.427897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1a6d5-0ca3-40be-befa-fb84315652e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:14.428532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1a6d5-0ca3-40be-befa-fb84315652e7 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.428818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1a6d5-0ca3-40be-befa-fb84315652e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.429096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1a6d5-0ca3-40be-befa-fb84315652e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.429849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1a6d5-0ca3-40be-befa-fb84315652e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:14.432301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1a6d5-0ca3-40be-befa-fb84315652e7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:14.462346 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b42b8d-f95e-4be7-8da3-71a77f1b21f1 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:14.467775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799b2ed-9e1c-43fb-b364-375363a87be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:14.468734 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b2ed-9e1c-43fb-b364-375363a87be9 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.469317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b2ed-9e1c-43fb-b364-375363a87be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.470015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b2ed-9e1c-43fb-b364-375363a87be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.481948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799b2ed-9e1c-43fb-b364-375363a87be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:14.486286 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799b2ed-9e1c-43fb-b364-375363a87be9 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:14.486429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 829/1674] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:14 2022] POST /identity/v3/projects => generated 405 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:14.488118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1a6d5-0ca3-40be-befa-fb84315652e7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:14.498920 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 846/1675] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:14.670200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1a6d5-0ca3-40be-befa-fb84315652e7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:14.676824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54583-4d70-49bd-b153-377a8ab26492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:14.678579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54583-4d70-49bd-b153-377a8ab26492 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.678959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54583-4d70-49bd-b153-377a8ab26492 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.679190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54583-4d70-49bd-b153-377a8ab26492 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.680546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d54583-4d70-49bd-b153-377a8ab26492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:14.682525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d54583-4d70-49bd-b153-377a8ab26492 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:14.715811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 830/1676] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:14 2022] POST /identity/v3/users => generated 303 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:14.719324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799b2ed-9e1c-43fb-b364-375363a87be9 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:14.732626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799b2ed-9e1c-43fb-b364-375363a87be9 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:14.739824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab4b6-405b-4060-8f3d-bab1fb9cc2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:14.740635 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab4b6-405b-4060-8f3d-bab1fb9cc2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.741075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab4b6-405b-4060-8f3d-bab1fb9cc2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.741426 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab4b6-405b-4060-8f3d-bab1fb9cc2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.742989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab4b6-405b-4060-8f3d-bab1fb9cc2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:14.745951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab4b6-405b-4060-8f3d-bab1fb9cc2c0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:14.761887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 847/1677] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:14.765957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54583-4d70-49bd-b153-377a8ab26492 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:14.779865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54583-4d70-49bd-b153-377a8ab26492 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:14.786553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a9dd0-777f-46ca-bc53-8b5d40a395dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:14.787267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a9dd0-777f-46ca-bc53-8b5d40a395dd admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.787590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a9dd0-777f-46ca-bc53-8b5d40a395dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.788052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a9dd0-777f-46ca-bc53-8b5d40a395dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.788726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a9dd0-777f-46ca-bc53-8b5d40a395dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:14.791148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a9dd0-777f-46ca-bc53-8b5d40a395dd admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:14.807900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 831/1678] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:14.809812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab4b6-405b-4060-8f3d-bab1fb9cc2c0 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:14.826012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab4b6-405b-4060-8f3d-bab1fb9cc2c0 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:14.837726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a78717-f711-4a88-9676-7e2a13cbb628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:14.838681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a78717-f711-4a88-9676-7e2a13cbb628 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.838984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a78717-f711-4a88-9676-7e2a13cbb628 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.839305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a78717-f711-4a88-9676-7e2a13cbb628 admin admin] PATH_INFO: `/v3/projects/f6b54f95ec804bff9f226a164f5fba32/users/913c1925ead746edbaf0606b40c87a2f/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.868507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a78717-f711-4a88-9676-7e2a13cbb628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b54f95ec804bff9f226a164f5fba32, user_id=913c1925ead746edbaf0606b40c87a2f, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:14.872141 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a78717-f711-4a88-9676-7e2a13cbb628 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:14.881654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:14.890944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 848/1679] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:14 2022] PUT /identity/v3/projects/f6b54f95ec804bff9f226a164f5fba32/users/913c1925ead746edbaf0606b40c87a2f/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:14.921042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca050cc-aec6-4dcf-aca7-fa4d70479ffe None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:14.921480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca050cc-aec6-4dcf-aca7-fa4d70479ffe None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:14.921480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca050cc-aec6-4dcf-aca7-fa4d70479ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:14.982618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-3ca050cc-aec6-4dcf-aca7-fa4d70479ffe None None] MFA Rules not processed for user `913c1925ead746edbaf0606b40c87a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:14.989822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-3ca050cc-aec6-4dcf-aca7-fa4d70479ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:14.993557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a78717-f711-4a88-9676-7e2a13cbb628 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.045975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:15.067667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 832/1680] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:15.072435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca050cc-aec6-4dcf-aca7-fa4d70479ffe None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.072646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a78717-f711-4a88-9676-7e2a13cbb628 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.077395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a54e34-38f4-47f9-aecb-2b72dd702630 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13c2094b3adc449b97bd071cc6d6289e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aedae4e67449d997f420439e7119a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.078561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a54e34-38f4-47f9-aecb-2b72dd702630 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.078561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a54e34-38f4-47f9-aecb-2b72dd702630 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.078713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a54e34-38f4-47f9-aecb-2b72dd702630 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.079445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a54e34-38f4-47f9-aecb-2b72dd702630 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:15.079929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a54e34-38f4-47f9-aecb-2b72dd702630 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.081754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a54e34-38f4-47f9-aecb-2b72dd702630 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:15.096383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 849/1681] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:50:15.100483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a54e34-38f4-47f9-aecb-2b72dd702630 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.112636 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a54e34-38f4-47f9-aecb-2b72dd702630 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.119932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c434-6e22-427a-9c4a-59d888de83f5 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13c2094b3adc449b97bd071cc6d6289e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aedae4e67449d997f420439e7119a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.120637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c434-6e22-427a-9c4a-59d888de83f5 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.121072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c434-6e22-427a-9c4a-59d888de83f5 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.121812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c434-6e22-427a-9c4a-59d888de83f5 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.131767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c434-6e22-427a-9c4a-59d888de83f5 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.134552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c434-6e22-427a-9c4a-59d888de83f5 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:15.179529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca050cc-aec6-4dcf-aca7-fa4d70479ffe None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.202178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 850/1682] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:15 2022] POST /identity/v3/projects => generated 353 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:15.206377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c434-6e22-427a-9c4a-59d888de83f5 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.210575 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72073292-0db2-47ad-ace0-a55aaa9c7b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.211970 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72073292-0db2-47ad-ace0-a55aaa9c7b72 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.212439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72073292-0db2-47ad-ace0-a55aaa9c7b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.213213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72073292-0db2-47ad-ace0-a55aaa9c7b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.213966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72073292-0db2-47ad-ace0-a55aaa9c7b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.216176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72073292-0db2-47ad-ace0-a55aaa9c7b72 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:15.254398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 833/1683] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:15 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:15.255452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72073292-0db2-47ad-ace0-a55aaa9c7b72 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.279353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c434-6e22-427a-9c4a-59d888de83f5 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.341114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72073292-0db2-47ad-ace0-a55aaa9c7b72 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.345580 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe043065-9507-4469-8391-32ee62323b75 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13c2094b3adc449b97bd071cc6d6289e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aedae4e67449d997f420439e7119a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.345754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1df1ac-b9fd-4399-a2bc-410ebdca5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.346204 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe043065-9507-4469-8391-32ee62323b75 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.346312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df1ac-b9fd-4399-a2bc-410ebdca5e89 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.346484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe043065-9507-4469-8391-32ee62323b75 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.346595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df1ac-b9fd-4399-a2bc-410ebdca5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.346758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe043065-9507-4469-8391-32ee62323b75 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.346853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df1ac-b9fd-4399-a2bc-410ebdca5e89 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.347461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe043065-9507-4469-8391-32ee62323b75 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:15.347563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1df1ac-b9fd-4399-a2bc-410ebdca5e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.347774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe043065-9507-4469-8391-32ee62323b75 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.349358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1df1ac-b9fd-4399-a2bc-410ebdca5e89 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:15.349466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe043065-9507-4469-8391-32ee62323b75 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:15.371308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 851/1684] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:50:15.388369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 834/1685] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:15 2022] POST /identity/v3/users => generated 311 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:15.389696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe043065-9507-4469-8391-32ee62323b75 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.401215 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe043065-9507-4469-8391-32ee62323b75 tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.409440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1df1ac-b9fd-4399-a2bc-410ebdca5e89 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.412633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5964a8-7e61-46cf-894b-600aa43f03c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.413279 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5964a8-7e61-46cf-894b-600aa43f03c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.413566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5964a8-7e61-46cf-894b-600aa43f03c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.414430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5964a8-7e61-46cf-894b-600aa43f03c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.415018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5964a8-7e61-46cf-894b-600aa43f03c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.417241 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5964a8-7e61-46cf-894b-600aa43f03c9 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:15.420155 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1df1ac-b9fd-4399-a2bc-410ebdca5e89 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.424457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:15.425586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13c2094b3adc449b97bd071cc6d6289e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35aedae4e67449d997f420439e7119a1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.426241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.426528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.426801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] PATH_INFO: `/v3/projects/5602e38c4b77477185b7aaeaae2e7b2c` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.427998 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5602e38c4b77477185b7aaeaae2e7b2c)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.430439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:15.430967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 852/1686] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:15.435078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5964a8-7e61-46cf-894b-600aa43f03c9 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.446171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5964a8-7e61-46cf-894b-600aa43f03c9 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.451093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bb199-4813-4d32-90e2-4d3d51e808f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.451881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bb199-4813-4d32-90e2-4d3d51e808f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.452287 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bb199-4813-4d32-90e2-4d3d51e808f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.452567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bb199-4813-4d32-90e2-4d3d51e808f3 admin admin] PATH_INFO: `/v3/projects/81cf1792b76b45e085a14de0b402fcf7/users/1db1b777819e42bbbe29d99eb316eba6/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.470165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bb199-4813-4d32-90e2-4d3d51e808f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cf1792b76b45e085a14de0b402fcf7, user_id=1db1b777819e42bbbe29d99eb316eba6, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.473260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bb199-4813-4d32-90e2-4d3d51e808f3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:15.484250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5602e38c4b77477185b7aaeaae2e7b2c', 'request_id': 'req-8e285daa-0540-409f-a71d-5876b63d5efa'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:15.488165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 853/1687] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:15 2022] PUT /identity/v3/projects/81cf1792b76b45e085a14de0b402fcf7/users/1db1b777819e42bbbe29d99eb316eba6/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:15.491453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5602e38c4b77477185b7aaeaae2e7b2c', 'request_id': 'req-8e285daa-0540-409f-a71d-5876b63d5efa'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:15.492128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bb199-4813-4d32-90e2-4d3d51e808f3 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.494559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:15.501150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5602e38c4b77477185b7aaeaae2e7b2c', 'request_id': 'req-8e285daa-0540-409f-a71d-5876b63d5efa'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:15.517001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] The token cache is being invalidate because project 5602e38c4b77477185b7aaeaae2e7b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:15.517422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:15.518114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:15.523098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 835/1688] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:15 2022] DELETE /identity/v3/projects/5602e38c4b77477185b7aaeaae2e7b2c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:15.609145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bb199-4813-4d32-90e2-4d3d51e808f3 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.617197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a287b8-1d27-486d-8097-3e05bc798828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.618900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a287b8-1d27-486d-8097-3e05bc798828 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.619319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a287b8-1d27-486d-8097-3e05bc798828 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.619752 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a287b8-1d27-486d-8097-3e05bc798828 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.620504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a287b8-1d27-486d-8097-3e05bc798828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.622357 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a287b8-1d27-486d-8097-3e05bc798828 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:15.644528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 854/1689] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:15.645677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.647133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:15.734621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e285daa-0540-409f-a71d-5876b63d5efa tempest-VolumeQuotaClassesTest-58101192 tempest-VolumeQuotaClassesTest-58101192-project-admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.739691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f8b5f-f344-4b39-ade5-90eaa4fc780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.740411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f8b5f-f344-4b39-ade5-90eaa4fc780c admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.740800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f8b5f-f344-4b39-ade5-90eaa4fc780c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.741091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f8b5f-f344-4b39-ade5-90eaa4fc780c admin admin] PATH_INFO: `/v3/projects/81cf1792b76b45e085a14de0b402fcf7/users/1db1b777819e42bbbe29d99eb316eba6/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.743567 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f8b5f-f344-4b39-ade5-90eaa4fc780c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cf1792b76b45e085a14de0b402fcf7, user_id=1db1b777819e42bbbe29d99eb316eba6, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.746516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f8b5f-f344-4b39-ade5-90eaa4fc780c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:15.767363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 836/1690] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:15 2022] PUT /identity/v3/projects/81cf1792b76b45e085a14de0b402fcf7/users/1db1b777819e42bbbe29d99eb316eba6/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:15.771101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e123d-9a2b-48f0-b9cc-5f3f1f1a99c2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.771443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e123d-9a2b-48f0-b9cc-5f3f1f1a99c2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.771718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e123d-9a2b-48f0-b9cc-5f3f1f1a99c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.805768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bc9e123d-9a2b-48f0-b9cc-5f3f1f1a99c2 None None] MFA Rules not processed for user `1db1b777819e42bbbe29d99eb316eba6`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:15.807711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bc9e123d-9a2b-48f0-b9cc-5f3f1f1a99c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:15.841643 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f8b5f-f344-4b39-ade5-90eaa4fc780c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.843914 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-522f8b5f-f344-4b39-ade5-90eaa4fc780c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:15.927724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 855/1691] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:15 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:15.935722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e123d-9a2b-48f0-b9cc-5f3f1f1a99c2 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:15.938541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bc9e123d-9a2b-48f0-b9cc-5f3f1f1a99c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:15.944327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f8b5f-f344-4b39-ade5-90eaa4fc780c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:15.951214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:15.952252 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:15.952439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:15.952698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] PATH_INFO: `/v3/users/d23a870739e94533b7964f796964dc53` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:15.962203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23a870739e94533b7964f796964dc53)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:15.964792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:16.033804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e123d-9a2b-48f0-b9cc-5f3f1f1a99c2 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:16.040262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cba6b3-d3b0-4912-9a89-b17ada159377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:16.040896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cba6b3-d3b0-4912-9a89-b17ada159377 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:16.041205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cba6b3-d3b0-4912-9a89-b17ada159377 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:16.041504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cba6b3-d3b0-4912-9a89-b17ada159377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:16.053817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cba6b3-d3b0-4912-9a89-b17ada159377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:16.056402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cba6b3-d3b0-4912-9a89-b17ada159377 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:16.064311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:16.065145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23a870739e94533b7964f796964dc53'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:16.076476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 856/1692] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:15 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:16.078558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23a870739e94533b7964f796964dc53'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:16.079408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23a870739e94533b7964f796964dc53'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:16.080029 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23a870739e94533b7964f796964dc53'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:16.090263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23a870739e94533b7964f796964dc53'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:16.107639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:16.118675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 837/1693] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:15 2022] DELETE /identity/v3/users/d23a870739e94533b7964f796964dc53 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:16.123304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec568b-764c-4c68-9a59-18c3109de7a6 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:16.123596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec568b-764c-4c68-9a59-18c3109de7a6 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:16.123867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec568b-764c-4c68-9a59-18c3109de7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:16.156273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-e2ec568b-764c-4c68-9a59-18c3109de7a6 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:16.157491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e2ec568b-764c-4c68-9a59-18c3109de7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:16.229376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 857/1694] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:16.261522 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:16.263392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:16.269364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec568b-764c-4c68-9a59-18c3109de7a6 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:16.271019 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e2ec568b-764c-4c68-9a59-18c3109de7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:16.344543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63098ed2-5092-46b6-8a88-ab9a3c657538 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:16.348386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e607d-287f-47dc-bed7-2943a09342cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:16.349005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e607d-287f-47dc-bed7-2943a09342cf service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:16.349279 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e607d-287f-47dc-bed7-2943a09342cf service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:16.350079 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e607d-287f-47dc-bed7-2943a09342cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:16.354185 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec568b-764c-4c68-9a59-18c3109de7a6 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:16.358054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe40740-b396-4a7a-8d0e-aaebfb964b52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:16.358773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40740-b396-4a7a-8d0e-aaebfb964b52 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:16.359218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40740-b396-4a7a-8d0e-aaebfb964b52 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:16.359540 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe40740-b396-4a7a-8d0e-aaebfb964b52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:16.359910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e607d-287f-47dc-bed7-2943a09342cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:16.361544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9fe40740-b396-4a7a-8d0e-aaebfb964b52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:16.361651 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e607d-287f-47dc-bed7-2943a09342cf service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:16.377067 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 838/1695] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:16.433916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe40740-b396-4a7a-8d0e-aaebfb964b52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:16.436416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe40740-b396-4a7a-8d0e-aaebfb964b52 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:16.448761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 858/1696] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:16 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:17.411124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e607d-287f-47dc-bed7-2943a09342cf service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:17.412709 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6f5e607d-287f-47dc-bed7-2943a09342cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:17.427441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e607d-287f-47dc-bed7-2943a09342cf service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:17.432601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:17.433243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:17.433530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:17.433805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] PATH_INFO: `/v3/projects/3e017d0394b34dcc8fe9c46e62b1afb5` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:17.434929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e017d0394b34dcc8fe9c46e62b1afb5)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:17.436961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:17.498750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e017d0394b34dcc8fe9c46e62b1afb5', 'request_id': 'req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:17.505535 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e017d0394b34dcc8fe9c46e62b1afb5', 'request_id': 'req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:17.514897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e017d0394b34dcc8fe9c46e62b1afb5', 'request_id': 'req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:17.529481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] The token cache is being invalidate because project 3e017d0394b34dcc8fe9c46e62b1afb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:17.529649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:17.530463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:17.535359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 839/1697] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:17 2022] DELETE /identity/v3/projects/3e017d0394b34dcc8fe9c46e62b1afb5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:17.536411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe40740-b396-4a7a-8d0e-aaebfb964b52 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:17.571238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe40740-b396-4a7a-8d0e-aaebfb964b52 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:17.632099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:17.639416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:17.640138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:17.640491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:17.640875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] PATH_INFO: `/v3/users/13c2094b3adc449b97bd071cc6d6289e` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:17.642015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c2094b3adc449b97bd071cc6d6289e)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:17.643988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:17.701042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c2094b3adc449b97bd071cc6d6289e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:17.709884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c2094b3adc449b97bd071cc6d6289e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:17.710593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c2094b3adc449b97bd071cc6d6289e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:17.711709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c2094b3adc449b97bd071cc6d6289e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:17.720198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4e1486c0-4728-4055-96ea-ff2d4aa46f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c2094b3adc449b97bd071cc6d6289e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:17.742997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 859/1698] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:17 2022] DELETE /identity/v3/users/13c2094b3adc449b97bd071cc6d6289e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:18.249642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:18.251404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:18.279606 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613be0a9-79be-4f7c-8da4-6e0f90ddfedc admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:18.376227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:18.376911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:18.377196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:18.377550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] PATH_INFO: `/v3/projects/35aedae4e67449d997f420439e7119a1` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:18.378905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35aedae4e67449d997f420439e7119a1)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:18.380872 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:18.418858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:18.443326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35aedae4e67449d997f420439e7119a1', 'request_id': 'req-b82313c1-ef2b-496f-ac6d-fd92efa5e734'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:18.449652 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35aedae4e67449d997f420439e7119a1', 'request_id': 'req-b82313c1-ef2b-496f-ac6d-fd92efa5e734'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:18.459134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35aedae4e67449d997f420439e7119a1', 'request_id': 'req-b82313c1-ef2b-496f-ac6d-fd92efa5e734'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:18.480529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] The token cache is being invalidate because project 35aedae4e67449d997f420439e7119a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:18.481098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:18.482673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b82313c1-ef2b-496f-ac6d-fd92efa5e734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:18.485273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 840/1699] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:18 2022] DELETE /identity/v3/projects/35aedae4e67449d997f420439e7119a1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:18.490091 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d77f4a-1993-4576-91d1-ecfe832decbf None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:18.490378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d77f4a-1993-4576-91d1-ecfe832decbf None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:18.490684 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d77f4a-1993-4576-91d1-ecfe832decbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:18.512300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d6d77f4a-1993-4576-91d1-ecfe832decbf None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:18.513549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d6d77f4a-1993-4576-91d1-ecfe832decbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:18.584639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 860/1700] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:18.592598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e352b-7144-4026-a151-737bd4ca146f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:18.592888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e352b-7144-4026-a151-737bd4ca146f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:18.593172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e352b-7144-4026-a151-737bd4ca146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:18.614586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-8b6e352b-7144-4026-a151-737bd4ca146f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:18.615517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8b6e352b-7144-4026-a151-737bd4ca146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:18.626133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 841/1701] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:18.630157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d77f4a-1993-4576-91d1-ecfe832decbf None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:18.639886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d77f4a-1993-4576-91d1-ecfe832decbf None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:18.644544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc5ad-0fec-4a38-9272-d5aa3ed03c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:18.645153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc5ad-0fec-4a38-9272-d5aa3ed03c68 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:18.645433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc5ad-0fec-4a38-9272-d5aa3ed03c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:18.645704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc5ad-0fec-4a38-9272-d5aa3ed03c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:18.646475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadc5ad-0fec-4a38-9272-d5aa3ed03c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:18.646781 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadc5ad-0fec-4a38-9272-d5aa3ed03c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:18.648462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadc5ad-0fec-4a38-9272-d5aa3ed03c68 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:18.691327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 861/1702] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:50:18.693882 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e352b-7144-4026-a151-737bd4ca146f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:18.706282 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e352b-7144-4026-a151-737bd4ca146f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:18.712426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d18b9-f771-4547-b8ab-194273342b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:18.713064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d18b9-f771-4547-b8ab-194273342b73 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:18.713333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d18b9-f771-4547-b8ab-194273342b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:18.713607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d18b9-f771-4547-b8ab-194273342b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:18.714249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d18b9-f771-4547-b8ab-194273342b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:18.716233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d18b9-f771-4547-b8ab-194273342b73 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:18.747816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 842/1703] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:18 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:18.751793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc5ad-0fec-4a38-9272-d5aa3ed03c68 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:18.762636 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc5ad-0fec-4a38-9272-d5aa3ed03c68 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:18.837305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e7ebb-dfc0-4944-a05a-78b18bdfcfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:18.837305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7ebb-dfc0-4944-a05a-78b18bdfcfbe admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:18.837305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7ebb-dfc0-4944-a05a-78b18bdfcfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:18.837305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7ebb-dfc0-4944-a05a-78b18bdfcfbe admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:18.837704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e7ebb-dfc0-4944-a05a-78b18bdfcfbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:18.837704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e7ebb-dfc0-4944-a05a-78b18bdfcfbe admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:18.846423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:18.865966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 862/1704] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:18 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:18.870453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d18b9-f771-4547-b8ab-194273342b73 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:18.882924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d18b9-f771-4547-b8ab-194273342b73 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:18.888561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2870424-679e-4a16-b416-bd84d359c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:18.889346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870424-679e-4a16-b416-bd84d359c49d admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:18.889631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870424-679e-4a16-b416-bd84d359c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:18.889904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870424-679e-4a16-b416-bd84d359c49d admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:18.890560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2870424-679e-4a16-b416-bd84d359c49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:18.892235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2870424-679e-4a16-b416-bd84d359c49d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:18.906768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 843/1705] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:18.908774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e7ebb-dfc0-4944-a05a-78b18bdfcfbe admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:18.921351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e7ebb-dfc0-4944-a05a-78b18bdfcfbe admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:18.926853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e748fc5-8a47-4ded-af5d-ed2a74447bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:18.927673 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748fc5-8a47-4ded-af5d-ed2a74447bbe admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:18.927956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748fc5-8a47-4ded-af5d-ed2a74447bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:18.928228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748fc5-8a47-4ded-af5d-ed2a74447bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:18.928873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e748fc5-8a47-4ded-af5d-ed2a74447bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:18.930866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e748fc5-8a47-4ded-af5d-ed2a74447bbe admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:18.953978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 863/1706] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:18.955164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2870424-679e-4a16-b416-bd84d359c49d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:18.971087 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2870424-679e-4a16-b416-bd84d359c49d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:18.976151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab1943-8651-4aab-8a07-365b05dabc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:18.976862 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab1943-8651-4aab-8a07-365b05dabc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:18.977146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab1943-8651-4aab-8a07-365b05dabc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:18.977440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab1943-8651-4aab-8a07-365b05dabc33 admin admin] PATH_INFO: `/v3/projects/c97969352b2e49e2987ab0bf1baaad26/users/cfdcd59f23a44f1abdf42f382df505cb/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:19.003017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab1943-8651-4aab-8a07-365b05dabc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97969352b2e49e2987ab0bf1baaad26, user_id=cfdcd59f23a44f1abdf42f382df505cb, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:19.006068 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab1943-8651-4aab-8a07-365b05dabc33 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:19.022181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 844/1707] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:18 2022] PUT /identity/v3/projects/c97969352b2e49e2987ab0bf1baaad26/users/cfdcd59f23a44f1abdf42f382df505cb/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:19.033534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82488361-33a0-480a-a10c-713e89162819 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:19.034020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82488361-33a0-480a-a10c-713e89162819 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:19.034422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82488361-33a0-480a-a10c-713e89162819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:19.066162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-82488361-33a0-480a-a10c-713e89162819 None None] MFA Rules not processed for user `cfdcd59f23a44f1abdf42f382df505cb`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:19.067575 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-82488361-33a0-480a-a10c-713e89162819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:19.143412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 864/1708] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:19.144131 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab1943-8651-4aab-8a07-365b05dabc33 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:19.235819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab1943-8651-4aab-8a07-365b05dabc33 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:19.241948 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c3c49-588e-4e45-b615-e22d2b33208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:19.243228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c3c49-588e-4e45-b615-e22d2b33208c admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:19.244257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c3c49-588e-4e45-b615-e22d2b33208c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:19.244257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c3c49-588e-4e45-b615-e22d2b33208c admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:19.244779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c3c49-588e-4e45-b615-e22d2b33208c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:19.249034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c3c49-588e-4e45-b615-e22d2b33208c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:19.310531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 845/1709] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:19 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:19.313555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82488361-33a0-480a-a10c-713e89162819 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:19.326708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82488361-33a0-480a-a10c-713e89162819 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:19.404268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56e870-e9a0-4c79-94ee-780058756f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:19.405031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e870-e9a0-4c79-94ee-780058756f09 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:19.405416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e870-e9a0-4c79-94ee-780058756f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:19.406031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e870-e9a0-4c79-94ee-780058756f09 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:19.406666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56e870-e9a0-4c79-94ee-780058756f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:19.408905 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56e870-e9a0-4c79-94ee-780058756f09 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:19.437822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 865/1710] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:19 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:19.442320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c3c49-588e-4e45-b615-e22d2b33208c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:19.456816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c3c49-588e-4e45-b615-e22d2b33208c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:19.463808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b40f4-b549-4cb7-8bda-eb0503385220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:19.464343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b40f4-b549-4cb7-8bda-eb0503385220 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:19.464627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b40f4-b549-4cb7-8bda-eb0503385220 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:19.465005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b40f4-b549-4cb7-8bda-eb0503385220 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:19.465719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b40f4-b549-4cb7-8bda-eb0503385220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:19.467570 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b40f4-b549-4cb7-8bda-eb0503385220 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:19.486045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 846/1711] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:19.488001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56e870-e9a0-4c79-94ee-780058756f09 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:19.500202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56e870-e9a0-4c79-94ee-780058756f09 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:19.512273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c95d48-ff35-4d35-8975-abdc67251192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:19.513687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c95d48-ff35-4d35-8975-abdc67251192 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:19.514254 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c95d48-ff35-4d35-8975-abdc67251192 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:19.518506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c95d48-ff35-4d35-8975-abdc67251192 admin admin] PATH_INFO: `/v3/projects/10f364d99b894ce18860d7050ef068d0/users/2aba1c49621e453a902e12f8f64d721c/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:19.537687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c95d48-ff35-4d35-8975-abdc67251192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f364d99b894ce18860d7050ef068d0, user_id=2aba1c49621e453a902e12f8f64d721c, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:19.540785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c95d48-ff35-4d35-8975-abdc67251192 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:19.557742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 866/1712] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:19 2022] PUT /identity/v3/projects/10f364d99b894ce18860d7050ef068d0/users/2aba1c49621e453a902e12f8f64d721c/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:19.562109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b40f4-b549-4cb7-8bda-eb0503385220 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:19.586539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b40f4-b549-4cb7-8bda-eb0503385220 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:19.619408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:19.715958 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34c9c6-1035-47ad-b9ff-c428462799ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:19.717141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34c9c6-1035-47ad-b9ff-c428462799ee admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:19.717887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34c9c6-1035-47ad-b9ff-c428462799ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:19.718393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34c9c6-1035-47ad-b9ff-c428462799ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:19.719322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34c9c6-1035-47ad-b9ff-c428462799ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:19.721545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34c9c6-1035-47ad-b9ff-c428462799ee admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:19.743547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 847/1713] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:19.748357 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c95d48-ff35-4d35-8975-abdc67251192 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:19.761884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c95d48-ff35-4d35-8975-abdc67251192 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:19.770665 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2098082-62c2-490c-82ac-c46d82104137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:19.771466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2098082-62c2-490c-82ac-c46d82104137 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:19.771819 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2098082-62c2-490c-82ac-c46d82104137 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:19.772164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2098082-62c2-490c-82ac-c46d82104137 admin admin] PATH_INFO: `/v3/projects/10f364d99b894ce18860d7050ef068d0/users/2aba1c49621e453a902e12f8f64d721c/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:19.774890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2098082-62c2-490c-82ac-c46d82104137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f364d99b894ce18860d7050ef068d0, user_id=2aba1c49621e453a902e12f8f64d721c, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:19.777895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2098082-62c2-490c-82ac-c46d82104137 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:19.791554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 867/1714] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:19 2022] PUT /identity/v3/projects/10f364d99b894ce18860d7050ef068d0/users/2aba1c49621e453a902e12f8f64d721c/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:19.803000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077930-43dd-4f68-99b2-b4c3c82b1aeb None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:19.803306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077930-43dd-4f68-99b2-b4c3c82b1aeb None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:19.803624 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077930-43dd-4f68-99b2-b4c3c82b1aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:19.841838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-50077930-43dd-4f68-99b2-b4c3c82b1aeb None None] MFA Rules not processed for user `2aba1c49621e453a902e12f8f64d721c`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:19.843311 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-50077930-43dd-4f68-99b2-b4c3c82b1aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:19.952545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 848/1715] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:19.971740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2098082-62c2-490c-82ac-c46d82104137 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:19.973795 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e2098082-62c2-490c-82ac-c46d82104137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:20.009956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:20.042713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2098082-62c2-490c-82ac-c46d82104137 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:20.046460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835adf1-ba4a-41b8-885b-547cdbf36e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:20.047208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835adf1-ba4a-41b8-885b-547cdbf36e45 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:20.047396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835adf1-ba4a-41b8-885b-547cdbf36e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:20.047677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835adf1-ba4a-41b8-885b-547cdbf36e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:20.058860 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835adf1-ba4a-41b8-885b-547cdbf36e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:20.060552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835adf1-ba4a-41b8-885b-547cdbf36e45 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:20.084468 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 868/1716] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:20.692778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50077930-43dd-4f68-99b2-b4c3c82b1aeb None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:20.764712 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50077930-43dd-4f68-99b2-b4c3c82b1aeb None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:20.770018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:20.770715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:20.771027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:20.771387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] PATH_INFO: `/v3/users/cfdcd59f23a44f1abdf42f382df505cb` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:20.772545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdcd59f23a44f1abdf42f382df505cb)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:20.774494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:20.829895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdcd59f23a44f1abdf42f382df505cb'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:20.831698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:20.850473 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdcd59f23a44f1abdf42f382df505cb'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:20.852330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdcd59f23a44f1abdf42f382df505cb'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:20.853416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdcd59f23a44f1abdf42f382df505cb'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:20.861566 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdcd59f23a44f1abdf42f382df505cb'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:20.880535 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 849/1717] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:20 2022] DELETE /identity/v3/users/cfdcd59f23a44f1abdf42f382df505cb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:20.885052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24690-e0ab-4902-b540-ddd537fefcc0 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:20.885543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24690-e0ab-4902-b540-ddd537fefcc0 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:20.885633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24690-e0ab-4902-b540-ddd537fefcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:20.904388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-f2d24690-e0ab-4902-b540-ddd537fefcc0 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:20.905659 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f2d24690-e0ab-4902-b540-ddd537fefcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:20.974015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 869/1718] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:20.981119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:20.982598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:21.050744 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ba79d-5770-47a4-85fa-bbabfbddbf82 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:21.056612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f931-6e24-4d12-8aff-dc54288bda61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:21.057126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f931-6e24-4d12-8aff-dc54288bda61 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:21.057482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f931-6e24-4d12-8aff-dc54288bda61 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:21.057828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f931-6e24-4d12-8aff-dc54288bda61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:21.067981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55f931-6e24-4d12-8aff-dc54288bda61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:21.069875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55f931-6e24-4d12-8aff-dc54288bda61 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:21.081592 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 850/1719] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:21.869329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d24690-e0ab-4902-b540-ddd537fefcc0 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:21.870910 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f2d24690-e0ab-4902-b540-ddd537fefcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:21.900672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d24690-e0ab-4902-b540-ddd537fefcc0 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:21.906606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:21.907363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:21.907699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:21.907989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] PATH_INFO: `/v3/projects/c97969352b2e49e2987ab0bf1baaad26` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:21.912576 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97969352b2e49e2987ab0bf1baaad26)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:21.915310 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:21.969531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97969352b2e49e2987ab0bf1baaad26', 'request_id': 'req-3089898b-1851-4dec-8c58-7bbb2afd5872'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:21.978348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97969352b2e49e2987ab0bf1baaad26', 'request_id': 'req-3089898b-1851-4dec-8c58-7bbb2afd5872'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:21.985788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97969352b2e49e2987ab0bf1baaad26', 'request_id': 'req-3089898b-1851-4dec-8c58-7bbb2afd5872'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:21.997266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] The token cache is being invalidate because project c97969352b2e49e2987ab0bf1baaad26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:21.997570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:21.998256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.000167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 870/1720] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:21 2022] DELETE /identity/v3/projects/c97969352b2e49e2987ab0bf1baaad26 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:22.005074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f931-6e24-4d12-8aff-dc54288bda61 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:22.015791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f931-6e24-4d12-8aff-dc54288bda61 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:22.078964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:22.079715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:22.080008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:22.080294 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] PATH_INFO: `/v3/users/2aba1c49621e453a902e12f8f64d721c` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:22.081566 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aba1c49621e453a902e12f8f64d721c)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:22.083993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:22.145490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aba1c49621e453a902e12f8f64d721c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.154250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aba1c49621e453a902e12f8f64d721c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.155219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aba1c49621e453a902e12f8f64d721c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.156489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aba1c49621e453a902e12f8f64d721c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.166106 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aba1c49621e453a902e12f8f64d721c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.172866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:22.199225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 851/1721] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:22 2022] DELETE /identity/v3/users/2aba1c49621e453a902e12f8f64d721c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:22.366868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:22.368557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:22.384398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089898b-1851-4dec-8c58-7bbb2afd5872 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:22.532020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:22.568353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:22.569120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:22.569483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:22.570469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] PATH_INFO: `/v3/users/913c1925ead746edbaf0606b40c87a2f` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:22.571877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=913c1925ead746edbaf0606b40c87a2f)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:22.576771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:22.631773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:22.633806 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:22.645918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913c1925ead746edbaf0606b40c87a2f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.647933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7194b-42b1-4cfe-807e-e4f55fcc8a5c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:22.667479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913c1925ead746edbaf0606b40c87a2f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.668779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913c1925ead746edbaf0606b40c87a2f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.668948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913c1925ead746edbaf0606b40c87a2f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.670687 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:22.671199 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:22.671721 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:22.672151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] PATH_INFO: `/v3/projects/10f364d99b894ce18860d7050ef068d0` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:22.674056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f364d99b894ce18860d7050ef068d0)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:22.677070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:22.679208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4ec8162f-830b-4693-b2d9-4b730ae391dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913c1925ead746edbaf0606b40c87a2f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.707082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 871/1722] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:22 2022] DELETE /identity/v3/users/913c1925ead746edbaf0606b40c87a2f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:22.712498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae0aa-eca6-4f8d-9ded-e8a4520b0d10 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:22.713348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae0aa-eca6-4f8d-9ded-e8a4520b0d10 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:22.713885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae0aa-eca6-4f8d-9ded-e8a4520b0d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:22.736775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-216ae0aa-eca6-4f8d-9ded-e8a4520b0d10 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:22.738548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-216ae0aa-eca6-4f8d-9ded-e8a4520b0d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:22.739257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f364d99b894ce18860d7050ef068d0', 'request_id': 'req-4bea7aff-6045-4689-be33-b3fb14a6a34c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.747037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f364d99b894ce18860d7050ef068d0', 'request_id': 'req-4bea7aff-6045-4689-be33-b3fb14a6a34c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.758238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f364d99b894ce18860d7050ef068d0', 'request_id': 'req-4bea7aff-6045-4689-be33-b3fb14a6a34c'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.775477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] The token cache is being invalidate because project 10f364d99b894ce18860d7050ef068d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:22.775887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.776555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4bea7aff-6045-4689-be33-b3fb14a6a34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:22.778433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 852/1723] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:22 2022] DELETE /identity/v3/projects/10f364d99b894ce18860d7050ef068d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:22.783858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f4167-4893-4482-860e-e976b2d3eaec None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:22.786101 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f4167-4893-4482-860e-e976b2d3eaec None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:22.786466 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f4167-4893-4482-860e-e976b2d3eaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:22.814490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-351f4167-4893-4482-860e-e976b2d3eaec None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:22.815768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-351f4167-4893-4482-860e-e976b2d3eaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:22.821114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 872/1724] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:22.827635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 853/1725] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:22.832376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ae0aa-eca6-4f8d-9ded-e8a4520b0d10 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:22.834464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-216ae0aa-eca6-4f8d-9ded-e8a4520b0d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:22.836558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbf31-5881-454d-9dcd-e13d19504f82 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:22.836956 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbf31-5881-454d-9dcd-e13d19504f82 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:22.837332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbf31-5881-454d-9dcd-e13d19504f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:22.858545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c1fbbf31-5881-454d-9dcd-e13d19504f82 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:22.859972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c1fbbf31-5881-454d-9dcd-e13d19504f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:22.869448 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 854/1726] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:22.873843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbf31-5881-454d-9dcd-e13d19504f82 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:22.883680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbf31-5881-454d-9dcd-e13d19504f82 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:22.889490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab13012-e98e-45d9-8651-9a5b85535ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:22.890178 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab13012-e98e-45d9-8651-9a5b85535ddb admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:22.890564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab13012-e98e-45d9-8651-9a5b85535ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:22.890838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab13012-e98e-45d9-8651-9a5b85535ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:22.891534 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab13012-e98e-45d9-8651-9a5b85535ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:22.891846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab13012-e98e-45d9-8651-9a5b85535ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:22.893440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab13012-e98e-45d9-8651-9a5b85535ddb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:22.905471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ae0aa-eca6-4f8d-9ded-e8a4520b0d10 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:22.911182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200065d-937c-4e0d-8e6b-69b9dba944ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:22.911943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200065d-937c-4e0d-8e6b-69b9dba944ed service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:22.912423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200065d-937c-4e0d-8e6b-69b9dba944ed service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:22.912642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 855/1727] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:50:22.912728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200065d-937c-4e0d-8e6b-69b9dba944ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:22.916745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab13012-e98e-45d9-8651-9a5b85535ddb admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:22.924390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200065d-937c-4e0d-8e6b-69b9dba944ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:22.926435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200065d-937c-4e0d-8e6b-69b9dba944ed service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:22.927598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab13012-e98e-45d9-8651-9a5b85535ddb admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:22.933582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21268e4a-238b-4e48-abbf-9d58081288d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:22.934423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21268e4a-238b-4e48-abbf-9d58081288d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:22.934710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21268e4a-238b-4e48-abbf-9d58081288d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:22.934987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21268e4a-238b-4e48-abbf-9d58081288d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:22.935661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21268e4a-238b-4e48-abbf-9d58081288d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:22.937880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21268e4a-238b-4e48-abbf-9d58081288d9 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:22.941574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 873/1728] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:22.973018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 856/1729] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:22 2022] POST /identity/v3/projects => generated 361 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:22.977881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200065d-937c-4e0d-8e6b-69b9dba944ed service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:22.991335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200065d-937c-4e0d-8e6b-69b9dba944ed service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:23.020994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:23.104214 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d116a-d76b-47d5-8c0c-c6a42c943e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:23.105873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d116a-d76b-47d5-8c0c-c6a42c943e76 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:23.106428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d116a-d76b-47d5-8c0c-c6a42c943e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:23.106850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d116a-d76b-47d5-8c0c-c6a42c943e76 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:23.107667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d116a-d76b-47d5-8c0c-c6a42c943e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:23.109934 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d116a-d76b-47d5-8c0c-c6a42c943e76 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:23.135573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 874/1730] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:22 2022] POST /identity/v3/users => generated 281 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:23.139802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21268e4a-238b-4e48-abbf-9d58081288d9 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:23.152403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21268e4a-238b-4e48-abbf-9d58081288d9 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:23.158691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc88bd3-0083-40f4-863d-dadda1d0bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:23.159585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88bd3-0083-40f4-863d-dadda1d0bc57 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:23.160000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88bd3-0083-40f4-863d-dadda1d0bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:23.160779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88bd3-0083-40f4-863d-dadda1d0bc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:23.161634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc88bd3-0083-40f4-863d-dadda1d0bc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:23.164803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc88bd3-0083-40f4-863d-dadda1d0bc57 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:23.187650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 857/1731] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:23.188003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d116a-d76b-47d5-8c0c-c6a42c943e76 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:23.201967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d116a-d76b-47d5-8c0c-c6a42c943e76 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:23.208628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d48fd-a46c-4bfa-8c73-75b2d6c3a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:23.209269 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d48fd-a46c-4bfa-8c73-75b2d6c3a817 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:23.209554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d48fd-a46c-4bfa-8c73-75b2d6c3a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:23.209834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d48fd-a46c-4bfa-8c73-75b2d6c3a817 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:23.210599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d48fd-a46c-4bfa-8c73-75b2d6c3a817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:23.212342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d48fd-a46c-4bfa-8c73-75b2d6c3a817 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:23.225085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 875/1732] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:23.230670 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc88bd3-0083-40f4-863d-dadda1d0bc57 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:23.258728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc88bd3-0083-40f4-863d-dadda1d0bc57 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:23.276955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67f7a-608a-4197-9e33-8dc94e98f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:23.277657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67f7a-608a-4197-9e33-8dc94e98f253 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:23.277945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67f7a-608a-4197-9e33-8dc94e98f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:23.278214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67f7a-608a-4197-9e33-8dc94e98f253 admin admin] PATH_INFO: `/v3/projects/c9e21a5dc5c24452901b9b0749d2a730/users/e2fc24087acd49bcb8ecf78882e17ced/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:23.321312 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67f7a-608a-4197-9e33-8dc94e98f253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e21a5dc5c24452901b9b0749d2a730, user_id=e2fc24087acd49bcb8ecf78882e17ced, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:23.322813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d48fd-a46c-4bfa-8c73-75b2d6c3a817 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:23.325217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e93d48fd-a46c-4bfa-8c73-75b2d6c3a817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:23.327082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67f7a-608a-4197-9e33-8dc94e98f253 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:23.352600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d48fd-a46c-4bfa-8c73-75b2d6c3a817 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:23.369319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 858/1733] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:23 2022] PUT /identity/v3/projects/c9e21a5dc5c24452901b9b0749d2a730/users/e2fc24087acd49bcb8ecf78882e17ced/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:23.371247 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b15fe-2d0f-423e-a713-a1659e27736a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:23.371567 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b15fe-2d0f-423e-a713-a1659e27736a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:23.371848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b15fe-2d0f-423e-a713-a1659e27736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:23.434521 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-dd9b15fe-2d0f-423e-a713-a1659e27736a None None] MFA Rules not processed for user `e2fc24087acd49bcb8ecf78882e17ced`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:23.436511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dd9b15fe-2d0f-423e-a713-a1659e27736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:23.485230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:23.485904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:23.486179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:23.486461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] PATH_INFO: `/v3/projects/f6b54f95ec804bff9f226a164f5fba32` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:23.487664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b54f95ec804bff9f226a164f5fba32)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:23.490176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:23.514128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:23.552658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b54f95ec804bff9f226a164f5fba32', 'request_id': 'req-51293252-7d35-44a6-ac33-47b02eca290e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:23.554900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 859/1734] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:23.566231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b54f95ec804bff9f226a164f5fba32', 'request_id': 'req-51293252-7d35-44a6-ac33-47b02eca290e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:23.575207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b54f95ec804bff9f226a164f5fba32', 'request_id': 'req-51293252-7d35-44a6-ac33-47b02eca290e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:23.600994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] The token cache is being invalidate because project f6b54f95ec804bff9f226a164f5fba32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:23.601349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:23.602031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:23.604140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 876/1735] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:23 2022] DELETE /identity/v3/projects/f6b54f95ec804bff9f226a164f5fba32 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:23.606904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b15fe-2d0f-423e-a713-a1659e27736a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:23.607770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:23.608376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dd9b15fe-2d0f-423e-a713-a1659e27736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:23.609276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:23.640426 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:23.693137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b15fe-2d0f-423e-a713-a1659e27736a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:23.705676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51293252-7d35-44a6-ac33-47b02eca290e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:23.714347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:23.715128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:23.715587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:23.716002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] PATH_INFO: `/v3/users/1db1b777819e42bbbe29d99eb316eba6` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:23.718208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db1b777819e42bbbe29d99eb316eba6)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:23.721418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:23.765156 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e192a2-9411-4a6b-baaf-b8c935c04437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:23.766513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e192a2-9411-4a6b-baaf-b8c935c04437 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:23.766513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e192a2-9411-4a6b-baaf-b8c935c04437 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:23.767008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e192a2-9411-4a6b-baaf-b8c935c04437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:23.769309 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a8e192a2-9411-4a6b-baaf-b8c935c04437 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:23.791016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db1b777819e42bbbe29d99eb316eba6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:23.802316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db1b777819e42bbbe29d99eb316eba6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:23.803859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db1b777819e42bbbe29d99eb316eba6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:23.804557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db1b777819e42bbbe29d99eb316eba6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:23.814747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db1b777819e42bbbe29d99eb316eba6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:23.834872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 877/1736] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:23 2022] DELETE /identity/v3/users/1db1b777819e42bbbe29d99eb316eba6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:23.845359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e192a2-9411-4a6b-baaf-b8c935c04437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:23.847329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e192a2-9411-4a6b-baaf-b8c935c04437 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:23.857537 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 860/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:23.876083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:23.879187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:23.994794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf4ff-c16a-4320-87b5-e1450ed85c15 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:23.999928 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:24.000691 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.000911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.001225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] PATH_INFO: `/v3/users/e2fc24087acd49bcb8ecf78882e17ced` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.002364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fc24087acd49bcb8ecf78882e17ced)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:24.004378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:24.105942 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:24.116643 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fc24087acd49bcb8ecf78882e17ced'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:24.126554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fc24087acd49bcb8ecf78882e17ced'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:24.127332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fc24087acd49bcb8ecf78882e17ced'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:24.128096 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fc24087acd49bcb8ecf78882e17ced'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:24.143575 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0ed7351d-f358-4cdf-9224-6e9f2bbab0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fc24087acd49bcb8ecf78882e17ced'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:24.166505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 878/1738] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:23 2022] DELETE /identity/v3/users/e2fc24087acd49bcb8ecf78882e17ced => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:24.166668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e192a2-9411-4a6b-baaf-b8c935c04437 service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:24.170743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04741-97e3-4791-8ef2-04caeaf8abff None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.171033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04741-97e3-4791-8ef2-04caeaf8abff None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.171345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04741-97e3-4791-8ef2-04caeaf8abff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.183974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e192a2-9411-4a6b-baaf-b8c935c04437 service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:24.199145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-eca04741-97e3-4791-8ef2-04caeaf8abff None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:24.200570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-eca04741-97e3-4791-8ef2-04caeaf8abff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:24.248387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:24.260970 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:24.261708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.262203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.262611 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] PATH_INFO: `/v3/projects/81cf1792b76b45e085a14de0b402fcf7` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.263899 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cf1792b76b45e085a14de0b402fcf7)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:24.265922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:24.275784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 879/1739] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:24.285413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04741-97e3-4791-8ef2-04caeaf8abff None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:24.287512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-eca04741-97e3-4791-8ef2-04caeaf8abff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:24.319721 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cf1792b76b45e085a14de0b402fcf7', 'request_id': 'req-577bce00-31e6-4c89-8834-81df6dcf1bf2'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:24.328443 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cf1792b76b45e085a14de0b402fcf7', 'request_id': 'req-577bce00-31e6-4c89-8834-81df6dcf1bf2'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:24.337542 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cf1792b76b45e085a14de0b402fcf7', 'request_id': 'req-577bce00-31e6-4c89-8834-81df6dcf1bf2'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:24.350120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] The token cache is being invalidate because project 81cf1792b76b45e085a14de0b402fcf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:24.350495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:24.351304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-577bce00-31e6-4c89-8834-81df6dcf1bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:24.353040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 861/1740] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:24 2022] DELETE /identity/v3/projects/81cf1792b76b45e085a14de0b402fcf7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:24.359002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8accaf-2161-43a6-807e-3ad53fb05291 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.359392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8accaf-2161-43a6-807e-3ad53fb05291 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.359749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8accaf-2161-43a6-807e-3ad53fb05291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.370085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04741-97e3-4791-8ef2-04caeaf8abff None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:24.383528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ce8accaf-2161-43a6-807e-3ad53fb05291 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:24.384946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ce8accaf-2161-43a6-807e-3ad53fb05291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:24.440773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2333780-ab3a-43f4-a1c7-203fe00b756d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:24.441411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2333780-ab3a-43f4-a1c7-203fe00b756d service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.441751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2333780-ab3a-43f4-a1c7-203fe00b756d service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.442066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2333780-ab3a-43f4-a1c7-203fe00b756d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.445578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d2333780-ab3a-43f4-a1c7-203fe00b756d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:24.482815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:24.509390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 862/1741] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:24.511564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ece5d1-a7ba-4e85-b4ff-d7c13d1b49b4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.511858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ece5d1-a7ba-4e85-b4ff-d7c13d1b49b4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.516475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ece5d1-a7ba-4e85-b4ff-d7c13d1b49b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.534527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2333780-ab3a-43f4-a1c7-203fe00b756d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:24.537423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2333780-ab3a-43f4-a1c7-203fe00b756d service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:24.541375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-27ece5d1-a7ba-4e85-b4ff-d7c13d1b49b4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:24.542597 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-27ece5d1-a7ba-4e85-b4ff-d7c13d1b49b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:24.551730 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 880/1742] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:24.568494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 863/1743] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:24.573042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2333780-ab3a-43f4-a1c7-203fe00b756d service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:24.584464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2333780-ab3a-43f4-a1c7-203fe00b756d service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:24.589564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0928cf-f2ed-4615-92b4-09af0ce6c05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:24.590262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0928cf-f2ed-4615-92b4-09af0ce6c05e admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.590616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0928cf-f2ed-4615-92b4-09af0ce6c05e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.590962 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0928cf-f2ed-4615-92b4-09af0ce6c05e admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.591900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0928cf-f2ed-4615-92b4-09af0ce6c05e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:24.592282 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0928cf-f2ed-4615-92b4-09af0ce6c05e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:24.594085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0928cf-f2ed-4615-92b4-09af0ce6c05e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:24.609485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 881/1744] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:50:24.613369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ece5d1-a7ba-4e85-b4ff-d7c13d1b49b4 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:24.628397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ece5d1-a7ba-4e85-b4ff-d7c13d1b49b4 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:24.641133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be0c01-37b4-42f9-8032-576c9d055e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:24.641856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0c01-37b4-42f9-8032-576c9d055e0e admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.642275 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0c01-37b4-42f9-8032-576c9d055e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.642620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0c01-37b4-42f9-8032-576c9d055e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.643371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be0c01-37b4-42f9-8032-576c9d055e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:24.646089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be0c01-37b4-42f9-8032-576c9d055e0e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:24.699314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 864/1745] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:24 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:24.703046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0928cf-f2ed-4615-92b4-09af0ce6c05e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:24.722425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0928cf-f2ed-4615-92b4-09af0ce6c05e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:24.863201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc137ba-b3d7-46d3-b3cc-8375d578d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:24.864162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc137ba-b3d7-46d3-b3cc-8375d578d3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.864555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc137ba-b3d7-46d3-b3cc-8375d578d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.865208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc137ba-b3d7-46d3-b3cc-8375d578d3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.866003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc137ba-b3d7-46d3-b3cc-8375d578d3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:24.868323 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc137ba-b3d7-46d3-b3cc-8375d578d3f7 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:24.898556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 882/1746] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:24 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:24.898686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be0c01-37b4-42f9-8032-576c9d055e0e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:24.909392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be0c01-37b4-42f9-8032-576c9d055e0e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:24.926166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c642746-6a62-4f3c-b1cb-efc7d969903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:24.926814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c642746-6a62-4f3c-b1cb-efc7d969903a admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.927105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c642746-6a62-4f3c-b1cb-efc7d969903a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.927539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c642746-6a62-4f3c-b1cb-efc7d969903a admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.928214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c642746-6a62-4f3c-b1cb-efc7d969903a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:24.931465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c642746-6a62-4f3c-b1cb-efc7d969903a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:24.958224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc137ba-b3d7-46d3-b3cc-8375d578d3f7 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:24.959608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 865/1747] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:24.974972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc137ba-b3d7-46d3-b3cc-8375d578d3f7 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:24.983047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f9ca-6013-45f5-a262-499ab99fa56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:24.983942 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f9ca-6013-45f5-a262-499ab99fa56b admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:24.984828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f9ca-6013-45f5-a262-499ab99fa56b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:24.985252 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f9ca-6013-45f5-a262-499ab99fa56b admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:24.986165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742f9ca-6013-45f5-a262-499ab99fa56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:24.988713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742f9ca-6013-45f5-a262-499ab99fa56b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.005095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c642746-6a62-4f3c-b1cb-efc7d969903a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.007610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-7c642746-6a62-4f3c-b1cb-efc7d969903a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:25.028149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 883/1748] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:25.030716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c642746-6a62-4f3c-b1cb-efc7d969903a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.032235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f9ca-6013-45f5-a262-499ab99fa56b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.043532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f9ca-6013-45f5-a262-499ab99fa56b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.046598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feb349-d231-4481-a994-767e27894bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.047507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb349-d231-4481-a994-767e27894bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.047991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb349-d231-4481-a994-767e27894bca admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.048992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb349-d231-4481-a994-767e27894bca admin admin] PATH_INFO: `/v3/projects/c9e21a5dc5c24452901b9b0749d2a730` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.049132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff2584-675b-4a87-b76d-d16753703479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.050351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2584-675b-4a87-b76d-d16753703479 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.050832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2584-675b-4a87-b76d-d16753703479 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.051595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2584-675b-4a87-b76d-d16753703479 admin admin] PATH_INFO: `/v3/projects/b7b9c15a9e1e44b3ba2cf2ee2a759df7/users/ffac316e98e442608ea1135f45ec1b3d/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.051919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feb349-d231-4481-a994-767e27894bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e21a5dc5c24452901b9b0749d2a730)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.058448 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feb349-d231-4481-a994-767e27894bca admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.074619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff2584-675b-4a87-b76d-d16753703479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b9c15a9e1e44b3ba2cf2ee2a759df7, user_id=ffac316e98e442608ea1135f45ec1b3d, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.078415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff2584-675b-4a87-b76d-d16753703479 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.109447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 884/1749] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:25 2022] PUT /identity/v3/projects/b7b9c15a9e1e44b3ba2cf2ee2a759df7/users/ffac316e98e442608ea1135f45ec1b3d/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:25.111259 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c642011-08d6-4f44-bd60-155cdff0efe9 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.111578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c642011-08d6-4f44-bd60-155cdff0efe9 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.113783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c642011-08d6-4f44-bd60-155cdff0efe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.132493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:25.153079 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-66feb349-d231-4481-a994-767e27894bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e21a5dc5c24452901b9b0749d2a730', 'request_id': 'req-66feb349-d231-4481-a994-767e27894bca'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:25.159744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-4c642011-08d6-4f44-bd60-155cdff0efe9 None None] MFA Rules not processed for user `ffac316e98e442608ea1135f45ec1b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:25.161184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4c642011-08d6-4f44-bd60-155cdff0efe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:25.162674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-66feb349-d231-4481-a994-767e27894bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e21a5dc5c24452901b9b0749d2a730', 'request_id': 'req-66feb349-d231-4481-a994-767e27894bca'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:25.173915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-66feb349-d231-4481-a994-767e27894bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e21a5dc5c24452901b9b0749d2a730', 'request_id': 'req-66feb349-d231-4481-a994-767e27894bca'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:25.191219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-66feb349-d231-4481-a994-767e27894bca admin admin] The token cache is being invalidate because project c9e21a5dc5c24452901b9b0749d2a730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:25.191646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-66feb349-d231-4481-a994-767e27894bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:25.192400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-66feb349-d231-4481-a994-767e27894bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:25.194415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 866/1750] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:25 2022] DELETE /identity/v3/projects/c9e21a5dc5c24452901b9b0749d2a730 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:25.199829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ebabf-4fd0-422a-8552-b8470861c3e3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.200132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ebabf-4fd0-422a-8552-b8470861c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.200623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ebabf-4fd0-422a-8552-b8470861c3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.229323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c95ebabf-4fd0-422a-8552-b8470861c3e3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:25.231431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c95ebabf-4fd0-422a-8552-b8470861c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:25.236432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:25.276292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 885/1751] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:25.285484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c642011-08d6-4f44-bd60-155cdff0efe9 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.292927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4c642011-08d6-4f44-bd60-155cdff0efe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:25.309092 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 867/1752] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:25.317623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc56ce-fd87-40a1-a363-dd886d5e6191 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.318110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc56ce-fd87-40a1-a363-dd886d5e6191 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.318464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc56ce-fd87-40a1-a363-dd886d5e6191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.342440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-7bbc56ce-fd87-40a1-a363-dd886d5e6191 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:25.348986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-7bbc56ce-fd87-40a1-a363-dd886d5e6191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:25.362575 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 868/1753] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:25.367079 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc56ce-fd87-40a1-a363-dd886d5e6191 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.385133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c642011-08d6-4f44-bd60-155cdff0efe9 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.387450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc56ce-fd87-40a1-a363-dd886d5e6191 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.391119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb6091-90ed-4512-89e8-1a1a8c4ea06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.392016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb6091-90ed-4512-89e8-1a1a8c4ea06b admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.392447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb6091-90ed-4512-89e8-1a1a8c4ea06b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.392881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb6091-90ed-4512-89e8-1a1a8c4ea06b admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.393522 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb6091-90ed-4512-89e8-1a1a8c4ea06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.394230 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9867e9b-b272-4926-b5e1-34a21fea9440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.394930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867e9b-b272-4926-b5e1-34a21fea9440 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.395454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867e9b-b272-4926-b5e1-34a21fea9440 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.395813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867e9b-b272-4926-b5e1-34a21fea9440 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.395925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb6091-90ed-4512-89e8-1a1a8c4ea06b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.396910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9867e9b-b272-4926-b5e1-34a21fea9440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:25.397305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9867e9b-b272-4926-b5e1-34a21fea9440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.401999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9867e9b-b272-4926-b5e1-34a21fea9440 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.417657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 869/1754] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:50:25.422351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9867e9b-b272-4926-b5e1-34a21fea9440 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.433385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 886/1755] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:25 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:25.437515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb6091-90ed-4512-89e8-1a1a8c4ea06b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.441986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9867e9b-b272-4926-b5e1-34a21fea9440 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.522222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2f205-734c-4e30-8555-34e27ea937fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.522222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2f205-734c-4e30-8555-34e27ea937fd admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.522222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2f205-734c-4e30-8555-34e27ea937fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.522222 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2f205-734c-4e30-8555-34e27ea937fd admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.522696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2f205-734c-4e30-8555-34e27ea937fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.524183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2f205-734c-4e30-8555-34e27ea937fd admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.532637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb6091-90ed-4512-89e8-1a1a8c4ea06b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.537789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30661e89-9395-4f56-a1c2-e23bc406168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.538418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661e89-9395-4f56-a1c2-e23bc406168f admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.539264 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661e89-9395-4f56-a1c2-e23bc406168f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.539679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661e89-9395-4f56-a1c2-e23bc406168f admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.540321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30661e89-9395-4f56-a1c2-e23bc406168f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.542310 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30661e89-9395-4f56-a1c2-e23bc406168f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.587220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 887/1756] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:25 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:25.590714 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30661e89-9395-4f56-a1c2-e23bc406168f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.592025 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 870/1757] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:25 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:25.597358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2f205-734c-4e30-8555-34e27ea937fd admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.609938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30661e89-9395-4f56-a1c2-e23bc406168f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.635743 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:25.673004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2f205-734c-4e30-8555-34e27ea937fd admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.678053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582797d-c535-4c95-a3bb-4c3198a258e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.678681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582797d-c535-4c95-a3bb-4c3198a258e7 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.678969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582797d-c535-4c95-a3bb-4c3198a258e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.680051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582797d-c535-4c95-a3bb-4c3198a258e7 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.680493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582797d-c535-4c95-a3bb-4c3198a258e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.682428 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582797d-c535-4c95-a3bb-4c3198a258e7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.686173 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c932c-a847-4df2-91cc-a06b4d753630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.686878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c932c-a847-4df2-91cc-a06b4d753630 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.687235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c932c-a847-4df2-91cc-a06b4d753630 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.687644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c932c-a847-4df2-91cc-a06b4d753630 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.688368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c932c-a847-4df2-91cc-a06b4d753630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.691052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c932c-a847-4df2-91cc-a06b4d753630 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.708951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 888/1758] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:25.709159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 871/1759] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:25 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:25.709243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c932c-a847-4df2-91cc-a06b4d753630 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.710082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582797d-c535-4c95-a3bb-4c3198a258e7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.720655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c932c-a847-4df2-91cc-a06b4d753630 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.720943 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582797d-c535-4c95-a3bb-4c3198a258e7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.725767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a316953-6121-4333-b19b-93a099654751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.725927 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad751-ef45-43dd-86d1-84b15c73a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.726578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316953-6121-4333-b19b-93a099654751 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.726703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad751-ef45-43dd-86d1-84b15c73a408 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.726934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad751-ef45-43dd-86d1-84b15c73a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.727037 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316953-6121-4333-b19b-93a099654751 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.727217 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad751-ef45-43dd-86d1-84b15c73a408 admin admin] PATH_INFO: `/v3/projects/388ec3eb9f054a91840fba5c8adf260a/users/11493d5402eb4edc87a67ba9a0099670/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.727425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316953-6121-4333-b19b-93a099654751 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.728169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a316953-6121-4333-b19b-93a099654751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.729765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a316953-6121-4333-b19b-93a099654751 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.731742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:25.746498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 889/1760] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:25.747187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbad751-ef45-43dd-86d1-84b15c73a408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388ec3eb9f054a91840fba5c8adf260a, user_id=11493d5402eb4edc87a67ba9a0099670, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.750290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbad751-ef45-43dd-86d1-84b15c73a408 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.750857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a316953-6121-4333-b19b-93a099654751 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.761488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a316953-6121-4333-b19b-93a099654751 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.766382 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 872/1761] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:25 2022] PUT /identity/v3/projects/388ec3eb9f054a91840fba5c8adf260a/users/11493d5402eb4edc87a67ba9a0099670/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:25.770351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad751-ef45-43dd-86d1-84b15c73a408 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.840665 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14845dc1-194a-4e8a-97e1-99b3c8b46bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.841298 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14845dc1-194a-4e8a-97e1-99b3c8b46bdd admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.842020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14845dc1-194a-4e8a-97e1-99b3c8b46bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.842020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14845dc1-194a-4e8a-97e1-99b3c8b46bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.842484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14845dc1-194a-4e8a-97e1-99b3c8b46bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.844265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14845dc1-194a-4e8a-97e1-99b3c8b46bdd admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.847851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad751-ef45-43dd-86d1-84b15c73a408 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.852721 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac57d21-41b5-4bf3-a6d2-ba2606dd1778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.853344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac57d21-41b5-4bf3-a6d2-ba2606dd1778 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.853629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac57d21-41b5-4bf3-a6d2-ba2606dd1778 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.853911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac57d21-41b5-4bf3-a6d2-ba2606dd1778 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.854694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 890/1762] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:25.854813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac57d21-41b5-4bf3-a6d2-ba2606dd1778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.856237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac57d21-41b5-4bf3-a6d2-ba2606dd1778 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.859133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14845dc1-194a-4e8a-97e1-99b3c8b46bdd admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.866506 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 873/1763] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:25.871514 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac57d21-41b5-4bf3-a6d2-ba2606dd1778 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:25.873200 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14845dc1-194a-4e8a-97e1-99b3c8b46bdd admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.878567 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3aa96-4a00-43f3-82b0-e8831847de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.879150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3aa96-4a00-43f3-82b0-e8831847de94 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.879476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3aa96-4a00-43f3-82b0-e8831847de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.879755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3aa96-4a00-43f3-82b0-e8831847de94 admin admin] PATH_INFO: `/v3/projects/cfacdf3b83f040d987df059f269cfc05/users/b0b97915b92c4f64b28c245e73e0affe/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.885242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac57d21-41b5-4bf3-a6d2-ba2606dd1778 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:25.892467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e94330-2879-4f62-9430-6cb0c4428f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:25.893074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e94330-2879-4f62-9430-6cb0c4428f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.893647 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e94330-2879-4f62-9430-6cb0c4428f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.893938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e94330-2879-4f62-9430-6cb0c4428f2c admin admin] PATH_INFO: `/v3/projects/388ec3eb9f054a91840fba5c8adf260a/users/11493d5402eb4edc87a67ba9a0099670/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.897620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e94330-2879-4f62-9430-6cb0c4428f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=388ec3eb9f054a91840fba5c8adf260a, user_id=11493d5402eb4edc87a67ba9a0099670, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.899808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3aa96-4a00-43f3-82b0-e8831847de94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfacdf3b83f040d987df059f269cfc05, user_id=b0b97915b92c4f64b28c245e73e0affe, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:25.902536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3aa96-4a00-43f3-82b0-e8831847de94 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.905548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e94330-2879-4f62-9430-6cb0c4428f2c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:25.919227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 874/1765] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:25 2022] PUT /identity/v3/projects/388ec3eb9f054a91840fba5c8adf260a/users/11493d5402eb4edc87a67ba9a0099670/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:25.923352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 891/1765] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:25 2022] PUT /identity/v3/projects/cfacdf3b83f040d987df059f269cfc05/users/b0b97915b92c4f64b28c245e73e0affe/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:25.929898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18b2a-85f2-45f1-9f6d-3a0a00c96eae None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.930376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18b2a-85f2-45f1-9f6d-3a0a00c96eae None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.930854 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18b2a-85f2-45f1-9f6d-3a0a00c96eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.938634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241e9a-3cca-4f3b-a528-130eb2b003f0 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:25.939204 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241e9a-3cca-4f3b-a528-130eb2b003f0 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:25.939677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241e9a-3cca-4f3b-a528-130eb2b003f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:25.975826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bf241e9a-3cca-4f3b-a528-130eb2b003f0 None None] MFA Rules not processed for user `11493d5402eb4edc87a67ba9a0099670`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:25.977255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bf241e9a-3cca-4f3b-a528-130eb2b003f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:25.978027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e5f18b2a-85f2-45f1-9f6d-3a0a00c96eae None None] MFA Rules not processed for user `b0b97915b92c4f64b28c245e73e0affe`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:25.979239 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e5f18b2a-85f2-45f1-9f6d-3a0a00c96eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:26.061524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 875/1766] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:26.072511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f18b2a-85f2-45f1-9f6d-3a0a00c96eae None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:26.074081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e5f18b2a-85f2-45f1-9f6d-3a0a00c96eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:26.079825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 892/1767] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:26.080731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:26.091107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241e9a-3cca-4f3b-a528-130eb2b003f0 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:26.092514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bf241e9a-3cca-4f3b-a528-130eb2b003f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:26.133178 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f18b2a-85f2-45f1-9f6d-3a0a00c96eae None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:26.137015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbe22b-dcf5-4869-9248-fd5ef27d095e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:26.137630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe22b-dcf5-4869-9248-fd5ef27d095e service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:26.137914 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe22b-dcf5-4869-9248-fd5ef27d095e service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:26.138194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe22b-dcf5-4869-9248-fd5ef27d095e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:26.146786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbe22b-dcf5-4869-9248-fd5ef27d095e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:26.148915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbe22b-dcf5-4869-9248-fd5ef27d095e service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:26.150018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241e9a-3cca-4f3b-a528-130eb2b003f0 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:26.153718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f9e64-d0be-435b-952c-8ea6b5b41425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:26.154328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9e64-d0be-435b-952c-8ea6b5b41425 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:26.154609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9e64-d0be-435b-952c-8ea6b5b41425 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:26.154889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9e64-d0be-435b-952c-8ea6b5b41425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:26.158189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 876/1768] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:26.162132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:26.165183 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f9e64-d0be-435b-952c-8ea6b5b41425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:26.166855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f9e64-d0be-435b-952c-8ea6b5b41425 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:26.177700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 893/1769] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:26.592348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbe22b-dcf5-4869-9248-fd5ef27d095e service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:26.683060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbe22b-dcf5-4869-9248-fd5ef27d095e service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:26.690740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:26.691657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:26.691918 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:26.692195 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] PATH_INFO: `/v3/users/ffac316e98e442608ea1135f45ec1b3d` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:26.694010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffac316e98e442608ea1135f45ec1b3d)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:26.696231 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:26.767924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffac316e98e442608ea1135f45ec1b3d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:26.775782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffac316e98e442608ea1135f45ec1b3d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:26.776500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffac316e98e442608ea1135f45ec1b3d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:26.777123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffac316e98e442608ea1135f45ec1b3d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:26.784568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffac316e98e442608ea1135f45ec1b3d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:26.805433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 877/1770] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:26 2022] DELETE /identity/v3/users/ffac316e98e442608ea1135f45ec1b3d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:26.809915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709339d5-1507-44f6-b3f4-2c17829c0d76 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:26.810290 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709339d5-1507-44f6-b3f4-2c17829c0d76 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:26.810638 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709339d5-1507-44f6-b3f4-2c17829c0d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:26.833581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-709339d5-1507-44f6-b3f4-2c17829c0d76 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:26.834950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-709339d5-1507-44f6-b3f4-2c17829c0d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:26.897756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 894/1771] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:26.908110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:26.909525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:26.945768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:26.977909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa4fc8-a716-460a-87d5-22132fb9e98a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:26.982220 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fa4e7-8320-4c8e-9a6b-50e2d8e7b4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:26.982813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fa4e7-8320-4c8e-9a6b-50e2d8e7b4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:26.983269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fa4e7-8320-4c8e-9a6b-50e2d8e7b4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:26.983643 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fa4e7-8320-4c8e-9a6b-50e2d8e7b4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:26.993852 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fa4e7-8320-4c8e-9a6b-50e2d8e7b4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:26.995435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fa4e7-8320-4c8e-9a6b-50e2d8e7b4d7 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:27.006956 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 878/1772] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:50:27.600856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7adcf7-4260-4fb0-83b6-1fdf0cdaa51e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:27.601453 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7adcf7-4260-4fb0-83b6-1fdf0cdaa51e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:27.601812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7adcf7-4260-4fb0-83b6-1fdf0cdaa51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:27.639959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-ad7adcf7-4260-4fb0-83b6-1fdf0cdaa51e None None] MFA Rules not processed for user `b0b97915b92c4f64b28c245e73e0affe`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:27.641273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ad7adcf7-4260-4fb0-83b6-1fdf0cdaa51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:27.682349 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fa4e7-8320-4c8e-9a6b-50e2d8e7b4d7 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:27.685553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e61fa4e7-8320-4c8e-9a6b-50e2d8e7b4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:27.722865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fa4e7-8320-4c8e-9a6b-50e2d8e7b4d7 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:27.757984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:27.757984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:27.758244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:27.758561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] PATH_INFO: `/v3/projects/b7b9c15a9e1e44b3ba2cf2ee2a759df7` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:27.759969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b9c15a9e1e44b3ba2cf2ee2a759df7)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:27.762045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:27.771223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 895/1773] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:27.851869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b9c15a9e1e44b3ba2cf2ee2a759df7', 'request_id': 'req-aa586bc9-48ab-4d26-bcde-992b31ecf754'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:27.864546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b9c15a9e1e44b3ba2cf2ee2a759df7', 'request_id': 'req-aa586bc9-48ab-4d26-bcde-992b31ecf754'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:27.880300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b9c15a9e1e44b3ba2cf2ee2a759df7', 'request_id': 'req-aa586bc9-48ab-4d26-bcde-992b31ecf754'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:27.895026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] The token cache is being invalidate because project b7b9c15a9e1e44b3ba2cf2ee2a759df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:27.895354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:27.896038 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:27.897596 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 879/1774] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:27 2022] DELETE /identity/v3/projects/b7b9c15a9e1e44b3ba2cf2ee2a759df7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:27.902362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7adcf7-4260-4fb0-83b6-1fdf0cdaa51e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:27.915374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7adcf7-4260-4fb0-83b6-1fdf0cdaa51e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:27.982401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:27.983235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:27.983586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:27.983867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] PATH_INFO: `/v3/users/11493d5402eb4edc87a67ba9a0099670` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:27.985333 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=11493d5402eb4edc87a67ba9a0099670)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:27.987628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:28.050692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:28.055496 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11493d5402eb4edc87a67ba9a0099670'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:28.066877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11493d5402eb4edc87a67ba9a0099670'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:28.067721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11493d5402eb4edc87a67ba9a0099670'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:28.068530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11493d5402eb4edc87a67ba9a0099670'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:28.077155 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11493d5402eb4edc87a67ba9a0099670'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:28.099713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 896/1775] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:27 2022] DELETE /identity/v3/users/11493d5402eb4edc87a67ba9a0099670 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:28.392667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:28.394672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:28.416807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa586bc9-48ab-4d26-bcde-992b31ecf754 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:28.477664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:28.478322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:28.478606 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:28.478886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] PATH_INFO: `/v3/projects/388ec3eb9f054a91840fba5c8adf260a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:28.483243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=388ec3eb9f054a91840fba5c8adf260a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:28.483243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:28.540009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388ec3eb9f054a91840fba5c8adf260a', 'request_id': 'req-b233ca61-717a-4206-b2f6-4c3ab7385333'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:28.564955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388ec3eb9f054a91840fba5c8adf260a', 'request_id': 'req-b233ca61-717a-4206-b2f6-4c3ab7385333'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:28.567671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:28.592212 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388ec3eb9f054a91840fba5c8adf260a', 'request_id': 'req-b233ca61-717a-4206-b2f6-4c3ab7385333'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:28.607662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] The token cache is being invalidate because project 388ec3eb9f054a91840fba5c8adf260a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:28.608224 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:28.609143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b233ca61-717a-4206-b2f6-4c3ab7385333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:28.613228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 880/1776] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:28 2022] DELETE /identity/v3/projects/388ec3eb9f054a91840fba5c8adf260a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:35.347739 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:35.349297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:35.444300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011d222-11c3-405e-a8b3-49eeab28b39a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:35.510221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43863cff-43fe-41a3-9eaa-2308ebfbceab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:35.511084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43863cff-43fe-41a3-9eaa-2308ebfbceab service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:35.511985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43863cff-43fe-41a3-9eaa-2308ebfbceab service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:35.512413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43863cff-43fe-41a3-9eaa-2308ebfbceab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:35.514594 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-43863cff-43fe-41a3-9eaa-2308ebfbceab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:35.606834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43863cff-43fe-41a3-9eaa-2308ebfbceab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:35.608498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43863cff-43fe-41a3-9eaa-2308ebfbceab service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:35.620519 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 897/1777] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:38.604227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:40.705502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270e706-0c9b-4fb0-8c01-f47b6c58b07e None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:40.706164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270e706-0c9b-4fb0-8c01-f47b6c58b07e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:40.706164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270e706-0c9b-4fb0-8c01-f47b6c58b07e None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:40.707811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 881/1778] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:50:40.715316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd9462-70b6-4644-9da9-a18fdacd6f42 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:40.715776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd9462-70b6-4644-9da9-a18fdacd6f42 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:40.716331 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd9462-70b6-4644-9da9-a18fdacd6f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:40.743611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-66dd9462-70b6-4644-9da9-a18fdacd6f42 None None] MFA Rules not processed for user `332a44161d204223983ed2aa3aef9317`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:40.744864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-66dd9462-70b6-4644-9da9-a18fdacd6f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:40.784841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270e706-0c9b-4fb0-8c01-f47b6c58b07e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:40.786576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8270e706-0c9b-4fb0-8c01-f47b6c58b07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:40.808808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:40.886770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 898/1779] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:50:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:40.895605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd9462-70b6-4644-9da9-a18fdacd6f42 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:40.897748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-66dd9462-70b6-4644-9da9-a18fdacd6f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:40.914280 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270e706-0c9b-4fb0-8c01-f47b6c58b07e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:40.925283 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:40.926129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:40.926541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:40.926961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] PATH_INFO: `/v3/users/65d7e0e126ba4259b39283ab582a3345` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:40.928449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d7e0e126ba4259b39283ab582a3345)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:40.930768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd9462-70b6-4644-9da9-a18fdacd6f42 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:40.931538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:40.942822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8b6a0-adfe-4da7-91d2-0d822cca16e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:40.943700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b6a0-adfe-4da7-91d2-0d822cca16e7 service placement] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:40.944082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b6a0-adfe-4da7-91d2-0d822cca16e7 service placement] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:40.944464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b6a0-adfe-4da7-91d2-0d822cca16e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:40.983917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8b6a0-adfe-4da7-91d2-0d822cca16e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:40.988748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8b6a0-adfe-4da7-91d2-0d822cca16e7 service placement] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:41.017280 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 899/1780] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:41.042437 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d7e0e126ba4259b39283ab582a3345'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:41.051081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d7e0e126ba4259b39283ab582a3345'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:41.051861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d7e0e126ba4259b39283ab582a3345'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:41.052685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d7e0e126ba4259b39283ab582a3345'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:41.061463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-75b299f3-6cee-471f-ae62-94929d7169ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d7e0e126ba4259b39283ab582a3345'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:41.083371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 882/1781] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:40 2022] DELETE /identity/v3/users/65d7e0e126ba4259b39283ab582a3345 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:50:41.283002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8b6a0-adfe-4da7-91d2-0d822cca16e7 service placement] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:41.310652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8b6a0-adfe-4da7-91d2-0d822cca16e7 service placement] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:41.404505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:41.405159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:41.405440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:41.405716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] PATH_INFO: `/v3/projects/7ff4531fbbd840fd90ed18953580fbf7` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:41.406923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff4531fbbd840fd90ed18953580fbf7)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:41.408945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:41.462086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff4531fbbd840fd90ed18953580fbf7', 'request_id': 'req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:41.473412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff4531fbbd840fd90ed18953580fbf7', 'request_id': 'req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:41.485231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff4531fbbd840fd90ed18953580fbf7', 'request_id': 'req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:41.496860 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] The token cache is being invalidate because project 7ff4531fbbd840fd90ed18953580fbf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:41.497149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:41.497815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b2b3c352-ebb4-4e33-91d3-a4a0d0f622a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:41.499337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 900/1782] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:41 2022] DELETE /identity/v3/projects/7ff4531fbbd840fd90ed18953580fbf7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:41.504124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3d884-622a-4212-8fdd-36552337672c None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:41.504418 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3d884-622a-4212-8fdd-36552337672c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:41.504701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3d884-622a-4212-8fdd-36552337672c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:41.525579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-dbc3d884-622a-4212-8fdd-36552337672c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:41.526797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dbc3d884-622a-4212-8fdd-36552337672c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:41.587536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 883/1783] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:41.596152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433559df-2365-4d9c-8c3f-ddf167525fa5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:41.596437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433559df-2365-4d9c-8c3f-ddf167525fa5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:41.596713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433559df-2365-4d9c-8c3f-ddf167525fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:41.617561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-433559df-2365-4d9c-8c3f-ddf167525fa5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:41.618817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-433559df-2365-4d9c-8c3f-ddf167525fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:41.627010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 901/1784] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:41.631259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3d884-622a-4212-8fdd-36552337672c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:41.641483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3d884-622a-4212-8fdd-36552337672c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:41.646086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1f123-2d26-47a2-9ada-7d39a2b26a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:41.646686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f123-2d26-47a2-9ada-7d39a2b26a91 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:41.646978 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f123-2d26-47a2-9ada-7d39a2b26a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:41.647296 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1f123-2d26-47a2-9ada-7d39a2b26a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:41.647987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1f123-2d26-47a2-9ada-7d39a2b26a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:41.648299 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1f123-2d26-47a2-9ada-7d39a2b26a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:41.649892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1f123-2d26-47a2-9ada-7d39a2b26a91 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:41.661376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 884/1785] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:50:41.665680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433559df-2365-4d9c-8c3f-ddf167525fa5 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:41.675005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433559df-2365-4d9c-8c3f-ddf167525fa5 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:41.680262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fee15-633c-4449-ad9d-2e799f346947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:41.680868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fee15-633c-4449-ad9d-2e799f346947 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:41.681153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fee15-633c-4449-ad9d-2e799f346947 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:41.681430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fee15-633c-4449-ad9d-2e799f346947 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:41.682067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fee15-633c-4449-ad9d-2e799f346947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:41.684030 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fee15-633c-4449-ad9d-2e799f346947 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:41.714541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 902/1786] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:41 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:41.719188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1f123-2d26-47a2-9ada-7d39a2b26a91 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:41.732239 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1f123-2d26-47a2-9ada-7d39a2b26a91 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:41.736582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:41.814521 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afa62a-e017-440b-a618-9f320c823b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:41.815262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afa62a-e017-440b-a618-9f320c823b84 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:41.815795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afa62a-e017-440b-a618-9f320c823b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:41.816156 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afa62a-e017-440b-a618-9f320c823b84 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:41.817594 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afa62a-e017-440b-a618-9f320c823b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:41.819512 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afa62a-e017-440b-a618-9f320c823b84 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:41.850776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 885/1787] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:41 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:41.856624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fee15-633c-4449-ad9d-2e799f346947 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:41.874765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fee15-633c-4449-ad9d-2e799f346947 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:41.881027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63002a8-e5a6-4fc1-86b4-e4404d2c2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:41.881656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63002a8-e5a6-4fc1-86b4-e4404d2c2713 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:41.881933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63002a8-e5a6-4fc1-86b4-e4404d2c2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:41.882207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63002a8-e5a6-4fc1-86b4-e4404d2c2713 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:41.883472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63002a8-e5a6-4fc1-86b4-e4404d2c2713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:41.885300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63002a8-e5a6-4fc1-86b4-e4404d2c2713 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:41.892790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:41.899656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 903/1788] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:41.903694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afa62a-e017-440b-a618-9f320c823b84 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:41.916897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afa62a-e017-440b-a618-9f320c823b84 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:41.921750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a98e1-74d2-428b-a849-ba3c11f68cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:41.922359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a98e1-74d2-428b-a849-ba3c11f68cec admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:41.922667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a98e1-74d2-428b-a849-ba3c11f68cec admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:41.922916 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a98e1-74d2-428b-a849-ba3c11f68cec admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:41.923745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a98e1-74d2-428b-a849-ba3c11f68cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:41.925167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a98e1-74d2-428b-a849-ba3c11f68cec admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:41.936812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 886/1789] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:50:41.940975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63002a8-e5a6-4fc1-86b4-e4404d2c2713 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:41.952146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63002a8-e5a6-4fc1-86b4-e4404d2c2713 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:41.957018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e06259-9338-4ee9-ad66-00c0290d11fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:41.957940 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e06259-9338-4ee9-ad66-00c0290d11fb admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:41.958222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e06259-9338-4ee9-ad66-00c0290d11fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:41.958495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e06259-9338-4ee9-ad66-00c0290d11fb admin admin] PATH_INFO: `/v3/projects/d99262a172794f1c8a4cc0acf91ffb98/users/c34c56b8b5e148109c56f0a0b36352a6/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:41.974560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e06259-9338-4ee9-ad66-00c0290d11fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99262a172794f1c8a4cc0acf91ffb98, user_id=c34c56b8b5e148109c56f0a0b36352a6, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:41.977303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e06259-9338-4ee9-ad66-00c0290d11fb admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:41.990809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 904/1790] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:41 2022] PUT /identity/v3/projects/d99262a172794f1c8a4cc0acf91ffb98/users/c34c56b8b5e148109c56f0a0b36352a6/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:42.001083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147e14-222c-4c2d-92d0-f4bf4f04b827 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:42.001378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147e14-222c-4c2d-92d0-f4bf4f04b827 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:42.001658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147e14-222c-4c2d-92d0-f4bf4f04b827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:42.029885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ba147e14-222c-4c2d-92d0-f4bf4f04b827 None None] MFA Rules not processed for user `c34c56b8b5e148109c56f0a0b36352a6`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:42.031100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ba147e14-222c-4c2d-92d0-f4bf4f04b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:42.095604 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 887/1791] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:42.100229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e06259-9338-4ee9-ad66-00c0290d11fb admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:42.161034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e06259-9338-4ee9-ad66-00c0290d11fb admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:42.166192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0199d8c-3709-401c-b7df-3c066df901a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:42.166792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199d8c-3709-401c-b7df-3c066df901a5 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:42.167073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199d8c-3709-401c-b7df-3c066df901a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:42.167381 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199d8c-3709-401c-b7df-3c066df901a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:42.168015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0199d8c-3709-401c-b7df-3c066df901a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:42.169915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0199d8c-3709-401c-b7df-3c066df901a5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:42.195961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 905/1792] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:42 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:42.200216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147e14-222c-4c2d-92d0-f4bf4f04b827 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:42.212708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147e14-222c-4c2d-92d0-f4bf4f04b827 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:42.268657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf73716-e917-4700-bace-41cf3081d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:42.269183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf73716-e917-4700-bace-41cf3081d181 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:42.269467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf73716-e917-4700-bace-41cf3081d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:42.269740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf73716-e917-4700-bace-41cf3081d181 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:42.270374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf73716-e917-4700-bace-41cf3081d181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:42.272341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf73716-e917-4700-bace-41cf3081d181 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:42.298210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 888/1793] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:42 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:42.299737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0199d8c-3709-401c-b7df-3c066df901a5 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:42.312046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0199d8c-3709-401c-b7df-3c066df901a5 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:42.316792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c68b20-94fd-4b60-90e4-a79ffb61e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:42.317401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68b20-94fd-4b60-90e4-a79ffb61e9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:42.317682 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68b20-94fd-4b60-90e4-a79ffb61e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:42.317958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68b20-94fd-4b60-90e4-a79ffb61e9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:42.318595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c68b20-94fd-4b60-90e4-a79ffb61e9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:42.320247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c68b20-94fd-4b60-90e4-a79ffb61e9c0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:42.331143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 906/1794] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:42.336353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf73716-e917-4700-bace-41cf3081d181 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:42.342710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:42.346561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf73716-e917-4700-bace-41cf3081d181 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:42.352740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c71ee-4cda-4732-95a6-c840ebd7cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:42.353396 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c71ee-4cda-4732-95a6-c840ebd7cb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:42.353685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c71ee-4cda-4732-95a6-c840ebd7cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:42.353970 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c71ee-4cda-4732-95a6-c840ebd7cb2d admin admin] PATH_INFO: `/v3/projects/2f480074383c4aa9a2ab80cc357e5027/users/0322bfcd289b4cc2a904c2c7b34d3741/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:42.368564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c71ee-4cda-4732-95a6-c840ebd7cb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f480074383c4aa9a2ab80cc357e5027, user_id=0322bfcd289b4cc2a904c2c7b34d3741, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:42.371215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c71ee-4cda-4732-95a6-c840ebd7cb2d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:42.386441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 889/1795] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:42 2022] PUT /identity/v3/projects/2f480074383c4aa9a2ab80cc357e5027/users/0322bfcd289b4cc2a904c2c7b34d3741/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:42.390309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c68b20-94fd-4b60-90e4-a79ffb61e9c0 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:42.401227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c68b20-94fd-4b60-90e4-a79ffb61e9c0 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:42.458486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78634ae-903d-4485-99c8-09b0e2ffe1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:42.459109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78634ae-903d-4485-99c8-09b0e2ffe1fb admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:42.459425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78634ae-903d-4485-99c8-09b0e2ffe1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:42.459707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78634ae-903d-4485-99c8-09b0e2ffe1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:42.460343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78634ae-903d-4485-99c8-09b0e2ffe1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:42.462438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78634ae-903d-4485-99c8-09b0e2ffe1fb admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:42.472191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 907/1796] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:42.476683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c71ee-4cda-4732-95a6-c840ebd7cb2d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:42.487089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c71ee-4cda-4732-95a6-c840ebd7cb2d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:42.491671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123a5fc-423a-4b43-a54f-54b94507c38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:42.492314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123a5fc-423a-4b43-a54f-54b94507c38b admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:42.492591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123a5fc-423a-4b43-a54f-54b94507c38b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:42.492861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123a5fc-423a-4b43-a54f-54b94507c38b admin admin] PATH_INFO: `/v3/projects/2f480074383c4aa9a2ab80cc357e5027/users/0322bfcd289b4cc2a904c2c7b34d3741/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:42.494748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123a5fc-423a-4b43-a54f-54b94507c38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f480074383c4aa9a2ab80cc357e5027, user_id=0322bfcd289b4cc2a904c2c7b34d3741, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:42.497402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123a5fc-423a-4b43-a54f-54b94507c38b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:42.507244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 890/1797] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:42 2022] PUT /identity/v3/projects/2f480074383c4aa9a2ab80cc357e5027/users/0322bfcd289b4cc2a904c2c7b34d3741/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:42.518785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced214a-5820-44fa-b295-4ffe6a643e37 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:42.519017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced214a-5820-44fa-b295-4ffe6a643e37 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:42.519321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced214a-5820-44fa-b295-4ffe6a643e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:42.547945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bced214a-5820-44fa-b295-4ffe6a643e37 None None] MFA Rules not processed for user `0322bfcd289b4cc2a904c2c7b34d3741`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:42.549219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bced214a-5820-44fa-b295-4ffe6a643e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:42.607525 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:42.647971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 908/1798] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:42.659515 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123a5fc-423a-4b43-a54f-54b94507c38b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:42.661394 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1123a5fc-423a-4b43-a54f-54b94507c38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:42.721159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123a5fc-423a-4b43-a54f-54b94507c38b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:42.724897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ee68-7ed3-4e47-9d51-6f6eb5e97afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:42.725505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ee68-7ed3-4e47-9d51-6f6eb5e97afe service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:42.725785 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ee68-7ed3-4e47-9d51-6f6eb5e97afe service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:42.726581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ee68-7ed3-4e47-9d51-6f6eb5e97afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:42.735464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9ee68-7ed3-4e47-9d51-6f6eb5e97afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:42.736879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9ee68-7ed3-4e47-9d51-6f6eb5e97afe service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:42.746689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 891/1799] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:42.821440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced214a-5820-44fa-b295-4ffe6a643e37 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:42.833546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced214a-5820-44fa-b295-4ffe6a643e37 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:42.838048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb5fc-b891-493e-adeb-8c3883df1469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:42.838669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb5fc-b891-493e-adeb-8c3883df1469 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:42.838939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb5fc-b891-493e-adeb-8c3883df1469 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:42.839213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb5fc-b891-493e-adeb-8c3883df1469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:42.903554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb5fc-b891-493e-adeb-8c3883df1469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:42.903554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb5fc-b891-493e-adeb-8c3883df1469 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:42.911654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 909/1800] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:50.697025 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f876-5f20-4969-9e55-0d5850337900 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:50.697471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f876-5f20-4969-9e55-0d5850337900 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:50.697628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f876-5f20-4969-9e55-0d5850337900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:50.716730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c699f876-5f20-4969-9e55-0d5850337900 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:50.717836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c699f876-5f20-4969-9e55-0d5850337900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:50.772176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 892/1801] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:50:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:50.817925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb5fc-b891-493e-adeb-8c3883df1469 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:50.819883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-774eb5fc-b891-493e-adeb-8c3883df1469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:50.889062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb5fc-b891-493e-adeb-8c3883df1469 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:50.894016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0ef5-7d8e-4b55-9134-f08f5707f710 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:50.894659 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0ef5-7d8e-4b55-9134-f08f5707f710 service swift] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:50.895050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0ef5-7d8e-4b55-9134-f08f5707f710 service swift] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:50.895348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0ef5-7d8e-4b55-9134-f08f5707f710 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:50.903959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d0ef5-7d8e-4b55-9134-f08f5707f710 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:50.905522 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d0ef5-7d8e-4b55-9134-f08f5707f710 service swift] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:50.913712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 910/1802] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:50:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:50:51.456715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836be3-744e-4536-8b85-3421e53282de None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:51.457350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836be3-744e-4536-8b85-3421e53282de None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:51.457688 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836be3-744e-4536-8b85-3421e53282de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:51.478438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b0836be3-744e-4536-8b85-3421e53282de None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:51.479862 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b0836be3-744e-4536-8b85-3421e53282de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:51.488640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 893/1803] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 04:50:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:50:51.502035 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0ef5-7d8e-4b55-9134-f08f5707f710 service swift] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:51.512959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d0ef5-7d8e-4b55-9134-f08f5707f710 service swift] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:51.518016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32704fc5-b556-47b7-a604-826212ace2eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:51.518620 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32704fc5-b556-47b7-a604-826212ace2eb service swift] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:51.518930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32704fc5-b556-47b7-a604-826212ace2eb service swift] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:51.519207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32704fc5-b556-47b7-a604-826212ace2eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:51.527869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32704fc5-b556-47b7-a604-826212ace2eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:51.529435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32704fc5-b556-47b7-a604-826212ace2eb service swift] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:51.540440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 911/1804] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:50:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:50:51.793484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88f0ef-8301-4721-b690-517d12d37a0e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:51.794081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88f0ef-8301-4721-b690-517d12d37a0e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:51.794442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88f0ef-8301-4721-b690-517d12d37a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:51.824463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5f88f0ef-8301-4721-b690-517d12d37a0e None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:51.827047 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5f88f0ef-8301-4721-b690-517d12d37a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:51.836569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 894/1805] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:50:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:51.849439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32704fc5-b556-47b7-a604-826212ace2eb service swift] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:51.860057 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32704fc5-b556-47b7-a604-826212ace2eb service swift] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:51.865991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149b9a9-b104-4b6e-8aa6-f91f29628cce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:51.866902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149b9a9-b104-4b6e-8aa6-f91f29628cce service swift] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:51.867258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149b9a9-b104-4b6e-8aa6-f91f29628cce service swift] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:51.867844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149b9a9-b104-4b6e-8aa6-f91f29628cce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:51.877023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149b9a9-b104-4b6e-8aa6-f91f29628cce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:51.878813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149b9a9-b104-4b6e-8aa6-f91f29628cce service swift] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:51.887838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 912/1806] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:50:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:50:52.252913 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb9e0c-7dd5-4aaf-80f7-30586160b089 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:52.253190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb9e0c-7dd5-4aaf-80f7-30586160b089 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:52.253469 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb9e0c-7dd5-4aaf-80f7-30586160b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:52.281819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-d1bb9e0c-7dd5-4aaf-80f7-30586160b089 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:52.283836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d1bb9e0c-7dd5-4aaf-80f7-30586160b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:52.295875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 895/1807] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 04:50:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:52.311195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149b9a9-b104-4b6e-8aa6-f91f29628cce service swift] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:52.325035 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149b9a9-b104-4b6e-8aa6-f91f29628cce service swift] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:52.331288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2ec01-aa28-49d3-a2e5-3a186e3228eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:52.331931 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ec01-aa28-49d3-a2e5-3a186e3228eb service swift] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:52.332469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ec01-aa28-49d3-a2e5-3a186e3228eb service swift] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:52.332775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ec01-aa28-49d3-a2e5-3a186e3228eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:52.343078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2ec01-aa28-49d3-a2e5-3a186e3228eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:52.344864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2ec01-aa28-49d3-a2e5-3a186e3228eb service swift] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:52.353306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 913/1808] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:50:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:50:54.648783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb9e0c-7dd5-4aaf-80f7-30586160b089 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:54.650194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d1bb9e0c-7dd5-4aaf-80f7-30586160b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:54.711476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:54.718069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb9e0c-7dd5-4aaf-80f7-30586160b089 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:54.722911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:54.723581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:54.723864 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:54.724138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] PATH_INFO: `/v3/users/b0b97915b92c4f64b28c245e73e0affe` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:54.725263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b97915b92c4f64b28c245e73e0affe)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:54.727211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:54.773462 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b97915b92c4f64b28c245e73e0affe'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:54.780385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b97915b92c4f64b28c245e73e0affe'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:54.781057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b97915b92c4f64b28c245e73e0affe'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:54.781764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b97915b92c4f64b28c245e73e0affe'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:54.788722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b97915b92c4f64b28c245e73e0affe'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:54.806096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 896/1809] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:50:54 2022] DELETE /identity/v3/users/b0b97915b92c4f64b28c245e73e0affe => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:54.810577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8b3b-db69-4a59-a1a0-6cc0f86104b2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:54.811146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8b3b-db69-4a59-a1a0-6cc0f86104b2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:54.811146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8b3b-db69-4a59-a1a0-6cc0f86104b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:54.830384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-be2e8b3b-db69-4a59-a1a0-6cc0f86104b2 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:54.831622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-be2e8b3b-db69-4a59-a1a0-6cc0f86104b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:54.844885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:54.893356 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 914/1810] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:54.903396 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:54.904838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:54.964739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcda57-2e1b-47a3-abf8-a915cc26758a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:54.968576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814cdee-203e-4274-863e-986b44e4a35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:54.969182 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814cdee-203e-4274-863e-986b44e4a35c service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:54.969484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814cdee-203e-4274-863e-986b44e4a35c service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:54.969768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814cdee-203e-4274-863e-986b44e4a35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:54.978888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814cdee-203e-4274-863e-986b44e4a35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:54.980344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814cdee-203e-4274-863e-986b44e4a35c service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:54.991831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 897/1811] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:55.172464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e8b3b-db69-4a59-a1a0-6cc0f86104b2 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:55.174614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-be2e8b3b-db69-4a59-a1a0-6cc0f86104b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:55.188098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e8b3b-db69-4a59-a1a0-6cc0f86104b2 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:55.193097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:55.193826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:55.194219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:55.194570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] PATH_INFO: `/v3/projects/cfacdf3b83f040d987df059f269cfc05` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:55.195863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfacdf3b83f040d987df059f269cfc05)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:55.198023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:55.250878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfacdf3b83f040d987df059f269cfc05', 'request_id': 'req-a4a984c9-917c-4c4d-b082-d700b859c22a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:55.258964 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfacdf3b83f040d987df059f269cfc05', 'request_id': 'req-a4a984c9-917c-4c4d-b082-d700b859c22a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:55.266683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfacdf3b83f040d987df059f269cfc05', 'request_id': 'req-a4a984c9-917c-4c4d-b082-d700b859c22a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:55.278459 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] The token cache is being invalidate because project cfacdf3b83f040d987df059f269cfc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:50:55.278869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:55.279611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a984c9-917c-4c4d-b082-d700b859c22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:50:55.283451 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 915/1812] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:50:55 2022] DELETE /identity/v3/projects/cfacdf3b83f040d987df059f269cfc05 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:55.286392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac762396-7f21-4575-bcb0-8efa1919e74d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:55.286683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac762396-7f21-4575-bcb0-8efa1919e74d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:55.286965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac762396-7f21-4575-bcb0-8efa1919e74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:55.309500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ac762396-7f21-4575-bcb0-8efa1919e74d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:55.310536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ac762396-7f21-4575-bcb0-8efa1919e74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:55.383546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 898/1813] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:55.393375 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da21b58-f6c6-4fd2-9f3b-161fcc0773c6 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:55.393859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da21b58-f6c6-4fd2-9f3b-161fcc0773c6 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:55.394164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da21b58-f6c6-4fd2-9f3b-161fcc0773c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:55.419418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-0da21b58-f6c6-4fd2-9f3b-161fcc0773c6 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:55.420965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0da21b58-f6c6-4fd2-9f3b-161fcc0773c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:55.432729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 916/1814] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:55.437214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac762396-7f21-4575-bcb0-8efa1919e74d None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:55.449328 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac762396-7f21-4575-bcb0-8efa1919e74d None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:55.458924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936201a-41b4-439c-8e79-767be69a8945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:55.460415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936201a-41b4-439c-8e79-767be69a8945 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:55.461009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936201a-41b4-439c-8e79-767be69a8945 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:55.461748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936201a-41b4-439c-8e79-767be69a8945 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:55.462291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936201a-41b4-439c-8e79-767be69a8945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:50:55.462734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936201a-41b4-439c-8e79-767be69a8945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:55.465651 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936201a-41b4-439c-8e79-767be69a8945 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:55.485601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 899/1815] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:50:55.489981 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da21b58-f6c6-4fd2-9f3b-161fcc0773c6 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:55.501135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da21b58-f6c6-4fd2-9f3b-161fcc0773c6 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:55.506583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957ff5e-d2ef-4920-b3e4-ab11226869ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:55.507972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957ff5e-d2ef-4920-b3e4-ab11226869ac admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:55.508474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957ff5e-d2ef-4920-b3e4-ab11226869ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:55.509009 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957ff5e-d2ef-4920-b3e4-ab11226869ac admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:55.509791 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957ff5e-d2ef-4920-b3e4-ab11226869ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:55.512731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957ff5e-d2ef-4920-b3e4-ab11226869ac admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:55.562209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 917/1816] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:50:55 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:50:55.566338 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936201a-41b4-439c-8e79-767be69a8945 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:55.575060 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:55.579397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936201a-41b4-439c-8e79-767be69a8945 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:55.671162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bec0-e543-4fa7-9757-ef25c183afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:55.671839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bec0-e543-4fa7-9757-ef25c183afdb admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:55.672110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bec0-e543-4fa7-9757-ef25c183afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:55.672381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bec0-e543-4fa7-9757-ef25c183afdb admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:55.673027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816bec0-e543-4fa7-9757-ef25c183afdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:55.674984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816bec0-e543-4fa7-9757-ef25c183afdb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:55.715336 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 900/1817] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:50:55 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:50:55.719230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957ff5e-d2ef-4920-b3e4-ab11226869ac admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:55.733744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957ff5e-d2ef-4920-b3e4-ab11226869ac admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:55.739010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0448a3-918e-49e2-a720-abf38247fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:55.739445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0448a3-918e-49e2-a720-abf38247fb2a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:55.739713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0448a3-918e-49e2-a720-abf38247fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:55.739989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0448a3-918e-49e2-a720-abf38247fb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:55.740833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0448a3-918e-49e2-a720-abf38247fb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:55.743167 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0448a3-918e-49e2-a720-abf38247fb2a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:55.758164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 918/1818] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:55.762830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bec0-e543-4fa7-9757-ef25c183afdb admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:55.772821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bec0-e543-4fa7-9757-ef25c183afdb admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:55.777538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcd530-4bad-4805-91e1-80357d3db5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:55.778139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd530-4bad-4805-91e1-80357d3db5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:55.778422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd530-4bad-4805-91e1-80357d3db5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:55.778696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd530-4bad-4805-91e1-80357d3db5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:55.779352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcd530-4bad-4805-91e1-80357d3db5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:55.780952 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcd530-4bad-4805-91e1-80357d3db5c9 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:55.791536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 901/1819] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:50:55.795771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0448a3-918e-49e2-a720-abf38247fb2a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:55.806093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0448a3-918e-49e2-a720-abf38247fb2a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:55.810767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1086bd-9f70-4be4-aa95-c3976513606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:55.811456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1086bd-9f70-4be4-aa95-c3976513606b admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:55.811737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1086bd-9f70-4be4-aa95-c3976513606b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:55.812011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1086bd-9f70-4be4-aa95-c3976513606b admin admin] PATH_INFO: `/v3/projects/c3e52f04a07245ee8cbe5c85ea8a30b1/users/508bedd24344422ab2009a0e96273854/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:55.826772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1086bd-9f70-4be4-aa95-c3976513606b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e52f04a07245ee8cbe5c85ea8a30b1, user_id=508bedd24344422ab2009a0e96273854, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:55.829458 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1086bd-9f70-4be4-aa95-c3976513606b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:55.843577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 919/1820] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:50:55 2022] PUT /identity/v3/projects/c3e52f04a07245ee8cbe5c85ea8a30b1/users/508bedd24344422ab2009a0e96273854/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:50:55.848932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ea5f3-1a56-463d-b35b-9eb5b975eac4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:55.849258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ea5f3-1a56-463d-b35b-9eb5b975eac4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:55.849534 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ea5f3-1a56-463d-b35b-9eb5b975eac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:55.869086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-343ea5f3-1a56-463d-b35b-9eb5b975eac4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:55.870287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-343ea5f3-1a56-463d-b35b-9eb5b975eac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:55.928961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 902/1821] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:55.938465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1086bd-9f70-4be4-aa95-c3976513606b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:55.940191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fc1086bd-9f70-4be4-aa95-c3976513606b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:55.984757 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:50:55.999750 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1086bd-9f70-4be4-aa95-c3976513606b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:56.003424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296c5a3-1ed6-4ee7-bf34-84940a8c72ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:56.004037 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296c5a3-1ed6-4ee7-bf34-84940a8c72ca service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:56.004350 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296c5a3-1ed6-4ee7-bf34-84940a8c72ca service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:56.004622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296c5a3-1ed6-4ee7-bf34-84940a8c72ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:56.013427 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296c5a3-1ed6-4ee7-bf34-84940a8c72ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:56.014840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296c5a3-1ed6-4ee7-bf34-84940a8c72ca service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:56.024673 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 920/1822] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:50:58.922262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b08d6c-6928-48a3-a21f-9ae710fb75ac None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:58.922779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b08d6c-6928-48a3-a21f-9ae710fb75ac None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:58.922871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b08d6c-6928-48a3-a21f-9ae710fb75ac None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:58.924241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 903/1823] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:50:59.205857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de428c0b-764f-468b-8ab5-8b912e203a0a None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:59.205857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de428c0b-764f-468b-8ab5-8b912e203a0a None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:59.205857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de428c0b-764f-468b-8ab5-8b912e203a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:59.241043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-de428c0b-764f-468b-8ab5-8b912e203a0a None None] MFA Rules not processed for user `332a44161d204223983ed2aa3aef9317`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:50:59.242439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-de428c0b-764f-468b-8ab5-8b912e203a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:59.359979 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 921/1824] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:50:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:50:59.373070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b08d6c-6928-48a3-a21f-9ae710fb75ac None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:50:59.374839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a3b08d6c-6928-48a3-a21f-9ae710fb75ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:50:59.403035 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b08d6c-6928-48a3-a21f-9ae710fb75ac None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:50:59.409910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389fa74-1f32-4836-95ce-9a7b3e5ad155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:50:59.410613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fa74-1f32-4836-95ce-9a7b3e5ad155 service placement] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:50:59.411155 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fa74-1f32-4836-95ce-9a7b3e5ad155 service placement] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:50:59.411536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fa74-1f32-4836-95ce-9a7b3e5ad155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:50:59.423188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389fa74-1f32-4836-95ce-9a7b3e5ad155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:50:59.424892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389fa74-1f32-4836-95ce-9a7b3e5ad155 service placement] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:50:59.437950 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 904/1825] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:50:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:00.099353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de428c0b-764f-468b-8ab5-8b912e203a0a None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:00.102175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-de428c0b-764f-468b-8ab5-8b912e203a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:00.140434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de428c0b-764f-468b-8ab5-8b912e203a0a None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:00.149242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:00.150468 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:00.150766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:00.151052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] PATH_INFO: `/v3/users/ebf1164982044762b0be0fc0d625cd81` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:00.152273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf1164982044762b0be0fc0d625cd81)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:00.155087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:00.240426 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf1164982044762b0be0fc0d625cd81'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:00.250460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf1164982044762b0be0fc0d625cd81'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:00.252132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf1164982044762b0be0fc0d625cd81'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:00.252754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf1164982044762b0be0fc0d625cd81'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:00.262607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-0675e167-1572-45ca-aacb-2892e6e28385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf1164982044762b0be0fc0d625cd81'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:00.296006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 922/1826] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:00 2022] DELETE /identity/v3/users/ebf1164982044762b0be0fc0d625cd81 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:00.599667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389fa74-1f32-4836-95ce-9a7b3e5ad155 service placement] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:00.615357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389fa74-1f32-4836-95ce-9a7b3e5ad155 service placement] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:00.650249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd27aa3-d425-43d6-84ef-95e5da76e8ff None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:00.650925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd27aa3-d425-43d6-84ef-95e5da76e8ff None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:00.651385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd27aa3-d425-43d6-84ef-95e5da76e8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:00.695492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-9dd27aa3-d425-43d6-84ef-95e5da76e8ff None None] MFA Rules not processed for user `508bedd24344422ab2009a0e96273854`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:00.696728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9dd27aa3-d425-43d6-84ef-95e5da76e8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:00.711024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:00.711828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:00.712119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:00.712401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] PATH_INFO: `/v3/projects/7353b90873414cd88e5ffc29f2134366` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:00.713568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7353b90873414cd88e5ffc29f2134366)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:00.715572 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:00.741189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:00.753038 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:00.791876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7353b90873414cd88e5ffc29f2134366', 'request_id': 'req-ff3258c5-efd2-41f3-983f-3140bec58e69'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:00.799319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 923/1827] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:00.800886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd27aa3-d425-43d6-84ef-95e5da76e8ff None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:00.802321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9dd27aa3-d425-43d6-84ef-95e5da76e8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:00.804678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7353b90873414cd88e5ffc29f2134366', 'request_id': 'req-ff3258c5-efd2-41f3-983f-3140bec58e69'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:00.814321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7353b90873414cd88e5ffc29f2134366', 'request_id': 'req-ff3258c5-efd2-41f3-983f-3140bec58e69'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:00.819775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd27aa3-d425-43d6-84ef-95e5da76e8ff None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:00.827338 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] The token cache is being invalidate because project 7353b90873414cd88e5ffc29f2134366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:00.827665 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:00.828327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:00.833199 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 905/1828] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:00 2022] DELETE /identity/v3/projects/7353b90873414cd88e5ffc29f2134366 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:00.834012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:00.835526 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:00.895646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ae56-96cd-461c-ad59-c0e4b8c89afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:00.896271 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ae56-96cd-461c-ad59-c0e4b8c89afb admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:00.896643 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ae56-96cd-461c-ad59-c0e4b8c89afb admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:00.896872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ae56-96cd-461c-ad59-c0e4b8c89afb admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:00.898085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0ae56-96cd-461c-ad59-c0e4b8c89afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:00.900203 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0ae56-96cd-461c-ad59-c0e4b8c89afb admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:00.944195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 924/1829] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:00 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:00.948937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ae56-96cd-461c-ad59-c0e4b8c89afb admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:00.950750 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-60f0ae56-96cd-461c-ad59-c0e4b8c89afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:00.955642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3258c5-efd2-41f3-983f-3140bec58e69 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:01.029958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ae56-96cd-461c-ad59-c0e4b8c89afb admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:01.035599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9661c-07ca-448e-be69-a75eb3ce53ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:01.036319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9661c-07ca-448e-be69-a75eb3ce53ca admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.036709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9661c-07ca-448e-be69-a75eb3ce53ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.037051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9661c-07ca-448e-be69-a75eb3ce53ca admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.037847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9661c-07ca-448e-be69-a75eb3ce53ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:01.039924 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9661c-07ca-448e-be69-a75eb3ce53ca admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:01.045794 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:01.046453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.046737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.047016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] PATH_INFO: `/v3/users/5703297327d04c2797cd9609feca3ad7` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.052134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5703297327d04c2797cd9609feca3ad7)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:01.055382 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:01.066257 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 925/1830] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:00 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:51:01.072380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9661c-07ca-448e-be69-a75eb3ce53ca admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:01.086458 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9661c-07ca-448e-be69-a75eb3ce53ca admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:01.090710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a6d6-3a77-4966-bf03-6a4995948f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:01.091151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a6d6-3a77-4966-bf03-6a4995948f13 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.091485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a6d6-3a77-4966-bf03-6a4995948f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.091769 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a6d6-3a77-4966-bf03-6a4995948f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.092498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38a6d6-3a77-4966-bf03-6a4995948f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:01.094188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38a6d6-3a77-4966-bf03-6a4995948f13 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:01.109861 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 926/1831] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:01.113826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a6d6-3a77-4966-bf03-6a4995948f13 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:01.128014 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a6d6-3a77-4966-bf03-6a4995948f13 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:01.131833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5703297327d04c2797cd9609feca3ad7'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.133211 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a6422-51d2-475b-9ae9-60031ffa0be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:01.133897 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a6422-51d2-475b-9ae9-60031ffa0be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.134185 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a6422-51d2-475b-9ae9-60031ffa0be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.134468 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a6422-51d2-475b-9ae9-60031ffa0be6 admin admin] PATH_INFO: `/v3/projects/1e740d7948854192a8c37a4b23449292/users/9a4d6e13f6d442de9dad4d420c2dc795/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.136703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:01.146507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5703297327d04c2797cd9609feca3ad7'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.148145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5703297327d04c2797cd9609feca3ad7'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.149257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5703297327d04c2797cd9609feca3ad7'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.165574 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5703297327d04c2797cd9609feca3ad7'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.166097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a6422-51d2-475b-9ae9-60031ffa0be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e740d7948854192a8c37a4b23449292, user_id=9a4d6e13f6d442de9dad4d420c2dc795, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:01.169155 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a6422-51d2-475b-9ae9-60031ffa0be6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:01.189309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 927/1832] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:01 2022] PUT /identity/v3/projects/1e740d7948854192a8c37a4b23449292/users/9a4d6e13f6d442de9dad4d420c2dc795/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:01.193353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a6422-51d2-475b-9ae9-60031ffa0be6 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:01.195119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-646a6422-51d2-475b-9ae9-60031ffa0be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:01.195246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 906/1833] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:00 2022] DELETE /identity/v3/users/5703297327d04c2797cd9609feca3ad7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:01.221809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:01.281998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a6422-51d2-475b-9ae9-60031ffa0be6 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:01.353844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e98736-8e2b-420b-b2f9-fb78a4481cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:01.354478 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e98736-8e2b-420b-b2f9-fb78a4481cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.354761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e98736-8e2b-420b-b2f9-fb78a4481cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.355033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e98736-8e2b-420b-b2f9-fb78a4481cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.355754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e98736-8e2b-420b-b2f9-fb78a4481cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:01.357351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e98736-8e2b-420b-b2f9-fb78a4481cd8 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:01.372277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 928/1834] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:51:01.375239 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:01.386145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951aab25-6dcb-4d7c-ad1e-10185c23356b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:01.396198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde6f18-5afc-436a-8950-ee2c75993702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:01.397183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6f18-5afc-436a-8950-ee2c75993702 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.398488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6f18-5afc-436a-8950-ee2c75993702 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.398781 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde6f18-5afc-436a-8950-ee2c75993702 admin admin] PATH_INFO: `/v3/projects/1e740d7948854192a8c37a4b23449292/users/9a4d6e13f6d442de9dad4d420c2dc795/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.401416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde6f18-5afc-436a-8950-ee2c75993702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e740d7948854192a8c37a4b23449292, user_id=9a4d6e13f6d442de9dad4d420c2dc795, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:01.401864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e98736-8e2b-420b-b2f9-fb78a4481cd8 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:01.404048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-87e98736-8e2b-420b-b2f9-fb78a4481cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:01.404187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde6f18-5afc-436a-8950-ee2c75993702 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:01.421749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e98736-8e2b-420b-b2f9-fb78a4481cd8 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:01.423820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 907/1835] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:01 2022] PUT /identity/v3/projects/1e740d7948854192a8c37a4b23449292/users/9a4d6e13f6d442de9dad4d420c2dc795/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:01.424877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde6f18-5afc-436a-8950-ee2c75993702 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:01.427021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ffde6f18-5afc-436a-8950-ee2c75993702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:01.571463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde6f18-5afc-436a-8950-ee2c75993702 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:01.574743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:01.575521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.577934 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.578311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] PATH_INFO: `/v3/users/d9de13b017b74fdb89e3da7bcd484fca` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.581433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:01.582358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.582708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.582826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9de13b017b74fdb89e3da7bcd484fca)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:01.582991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] PATH_INFO: `/v3/projects/a24e6d09a92f4695815486eee000c197` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.584359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24e6d09a92f4695815486eee000c197)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:01.585118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:01.588600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:01.651270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24e6d09a92f4695815486eee000c197', 'request_id': 'req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.661589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24e6d09a92f4695815486eee000c197', 'request_id': 'req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.666493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9de13b017b74fdb89e3da7bcd484fca'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.675240 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24e6d09a92f4695815486eee000c197', 'request_id': 'req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.683502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9de13b017b74fdb89e3da7bcd484fca'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.684950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9de13b017b74fdb89e3da7bcd484fca'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.686476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9de13b017b74fdb89e3da7bcd484fca'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.689888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] The token cache is being invalidate because project a24e6d09a92f4695815486eee000c197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:01.690272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.692104 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3842b5b6-9af8-40dc-9524-f0e2e4be62ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.694948 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 908/1836] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:01 2022] DELETE /identity/v3/projects/a24e6d09a92f4695815486eee000c197 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:01.701118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a4a4eae2-0215-411b-88d8-dce19aa686d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9de13b017b74fdb89e3da7bcd484fca'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:01.701391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ffd1f-a549-4c6a-be63-0c7679676dfb None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.702105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ffd1f-a549-4c6a-be63-0c7679676dfb None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.702782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ffd1f-a549-4c6a-be63-0c7679676dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.713710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:01.736374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-df4ffd1f-a549-4c6a-be63-0c7679676dfb None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:01.737846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-df4ffd1f-a549-4c6a-be63-0c7679676dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:01.745592 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 929/1837] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:01 2022] DELETE /identity/v3/users/d9de13b017b74fdb89e3da7bcd484fca => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:01.750788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745037dd-2ca6-40e8-9cb5-4d481c8f0b6d None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.751338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745037dd-2ca6-40e8-9cb5-4d481c8f0b6d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.751834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745037dd-2ca6-40e8-9cb5-4d481c8f0b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.777234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-745037dd-2ca6-40e8-9cb5-4d481c8f0b6d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:01.778814 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-745037dd-2ca6-40e8-9cb5-4d481c8f0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:01.827507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:01.880699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 909/1838] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:01.881605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 930/1839] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:01.888912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9fc50-2d71-4a6d-b2fe-cc9c0aa63410 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:01.889870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9fc50-2d71-4a6d-b2fe-cc9c0aa63410 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:01.889870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9fc50-2d71-4a6d-b2fe-cc9c0aa63410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:01.894834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745037dd-2ca6-40e8-9cb5-4d481c8f0b6d None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:01.898941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-745037dd-2ca6-40e8-9cb5-4d481c8f0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:01.937586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e3a9fc50-2d71-4a6d-b2fe-cc9c0aa63410 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:01.938876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e3a9fc50-2d71-4a6d-b2fe-cc9c0aa63410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:01.976109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 910/1840] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:01.977044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9fc50-2d71-4a6d-b2fe-cc9c0aa63410 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:01.988637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9fc50-2d71-4a6d-b2fe-cc9c0aa63410 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.001412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce320a-4209-4bd6-904e-f38f8f90c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.002184 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce320a-4209-4bd6-904e-f38f8f90c674 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.002470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce320a-4209-4bd6-904e-f38f8f90c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.002746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce320a-4209-4bd6-904e-f38f8f90c674 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.003448 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce320a-4209-4bd6-904e-f38f8f90c674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:02.003747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce320a-4209-4bd6-904e-f38f8f90c674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.005354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce320a-4209-4bd6-904e-f38f8f90c674 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.037532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 911/1841] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:51:02.038398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce320a-4209-4bd6-904e-f38f8f90c674 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.044432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745037dd-2ca6-40e8-9cb5-4d481c8f0b6d None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.049758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce320a-4209-4bd6-904e-f38f8f90c674 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.050524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca6089-f804-4b8c-8697-370a383733e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.051345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca6089-f804-4b8c-8697-370a383733e0 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.052421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca6089-f804-4b8c-8697-370a383733e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.052947 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca6089-f804-4b8c-8697-370a383733e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.056184 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d89f4c-bf6e-43d9-85f6-245d09c6893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.057105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d89f4c-bf6e-43d9-85f6-245d09c6893f admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.057373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d89f4c-bf6e-43d9-85f6-245d09c6893f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.057693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d89f4c-bf6e-43d9-85f6-245d09c6893f admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.058602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d89f4c-bf6e-43d9-85f6-245d09c6893f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.061315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d89f4c-bf6e-43d9-85f6-245d09c6893f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.066019 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca6089-f804-4b8c-8697-370a383733e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.068234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca6089-f804-4b8c-8697-370a383733e0 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.081612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 931/1842] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:02.105207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 912/1843] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:02 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:02.110003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca6089-f804-4b8c-8697-370a383733e0 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.125165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca6089-f804-4b8c-8697-370a383733e0 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.219002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79144b-ee36-4599-9ad9-0793f2f4463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.219829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79144b-ee36-4599-9ad9-0793f2f4463c admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.220604 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79144b-ee36-4599-9ad9-0793f2f4463c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.220604 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79144b-ee36-4599-9ad9-0793f2f4463c admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.221598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79144b-ee36-4599-9ad9-0793f2f4463c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.224485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79144b-ee36-4599-9ad9-0793f2f4463c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.266832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d89f4c-bf6e-43d9-85f6-245d09c6893f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.275700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 932/1844] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:02 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:02.283825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d89f4c-bf6e-43d9-85f6-245d09c6893f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.297147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7799cd-6436-4a0f-aa0b-0ac3df5ab9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.297775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7799cd-6436-4a0f-aa0b-0ac3df5ab9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.298054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7799cd-6436-4a0f-aa0b-0ac3df5ab9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.298325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7799cd-6436-4a0f-aa0b-0ac3df5ab9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.299177 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7799cd-6436-4a0f-aa0b-0ac3df5ab9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.302027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7799cd-6436-4a0f-aa0b-0ac3df5ab9b9 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.316439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 913/1845] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:02.321561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79144b-ee36-4599-9ad9-0793f2f4463c admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.334196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79144b-ee36-4599-9ad9-0793f2f4463c admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.352151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc22434-bbf4-43ac-9d54-73ccea7cc696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.352974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc22434-bbf4-43ac-9d54-73ccea7cc696 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.353267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc22434-bbf4-43ac-9d54-73ccea7cc696 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.353543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc22434-bbf4-43ac-9d54-73ccea7cc696 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.354201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc22434-bbf4-43ac-9d54-73ccea7cc696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.355926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc22434-bbf4-43ac-9d54-73ccea7cc696 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.385232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 933/1846] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:02.389162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7799cd-6436-4a0f-aa0b-0ac3df5ab9b9 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.402681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7799cd-6436-4a0f-aa0b-0ac3df5ab9b9 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.409245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66543b13-9d46-491d-97da-7f4b9f833beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.410012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543b13-9d46-491d-97da-7f4b9f833beb admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.410295 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543b13-9d46-491d-97da-7f4b9f833beb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.411438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543b13-9d46-491d-97da-7f4b9f833beb admin admin] PATH_INFO: `/v3/projects/acb62324b8cc430994e00f59c874779f/users/304a5e03096e4ec9a683127fa7ad0f05/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.445783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66543b13-9d46-491d-97da-7f4b9f833beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb62324b8cc430994e00f59c874779f, user_id=304a5e03096e4ec9a683127fa7ad0f05, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.449767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66543b13-9d46-491d-97da-7f4b9f833beb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.479465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 914/1847] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:02 2022] PUT /identity/v3/projects/acb62324b8cc430994e00f59c874779f/users/304a5e03096e4ec9a683127fa7ad0f05/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:02.491791 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f1fb6-c477-4b83-a922-e16f702d35c3 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.491988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f1fb6-c477-4b83-a922-e16f702d35c3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.492662 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f1fb6-c477-4b83-a922-e16f702d35c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.506297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:02.552794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2b3f1fb6-c477-4b83-a922-e16f702d35c3 None None] MFA Rules not processed for user `304a5e03096e4ec9a683127fa7ad0f05`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:02.554133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2b3f1fb6-c477-4b83-a922-e16f702d35c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:02.586016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66543b13-9d46-491d-97da-7f4b9f833beb admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.587857 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-66543b13-9d46-491d-97da-7f4b9f833beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:02.693378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66543b13-9d46-491d-97da-7f4b9f833beb admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.696398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 934/1848] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:02.697398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f1fb6-c477-4b83-a922-e16f702d35c3 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.701353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.702515 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.703035 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.703782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] PATH_INFO: `/v3/projects/c34797a7aeae4563a1ffb135674c7121` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.706034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34797a7aeae4563a1ffb135674c7121)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.708854 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.712836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f1fb6-c477-4b83-a922-e16f702d35c3 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.720882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298b080-5c32-45c4-9f50-1baecfc4de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.723125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b080-5c32-45c4-9f50-1baecfc4de21 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.723125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b080-5c32-45c4-9f50-1baecfc4de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.723125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298b080-5c32-45c4-9f50-1baecfc4de21 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.723435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298b080-5c32-45c4-9f50-1baecfc4de21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.725812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298b080-5c32-45c4-9f50-1baecfc4de21 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.768358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 935/1849] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:02 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:02.769245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298b080-5c32-45c4-9f50-1baecfc4de21 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.778442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34797a7aeae4563a1ffb135674c7121', 'request_id': 'req-f69895d2-2f01-48bc-9199-514ad3ac3ccc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:02.790062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34797a7aeae4563a1ffb135674c7121', 'request_id': 'req-f69895d2-2f01-48bc-9199-514ad3ac3ccc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:02.799383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34797a7aeae4563a1ffb135674c7121', 'request_id': 'req-f69895d2-2f01-48bc-9199-514ad3ac3ccc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:02.814102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:02.845850 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] The token cache is being invalidate because project c34797a7aeae4563a1ffb135674c7121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:02.848920 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:02.852134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f69895d2-2f01-48bc-9199-514ad3ac3ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:02.854415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 915/1850] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:02 2022] DELETE /identity/v3/projects/c34797a7aeae4563a1ffb135674c7121 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:02.861471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab4c54-32d8-47bf-8b04-a888a4f5e6c8 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.861895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab4c54-32d8-47bf-8b04-a888a4f5e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.862378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab4c54-32d8-47bf-8b04-a888a4f5e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.872694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298b080-5c32-45c4-9f50-1baecfc4de21 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.879327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f51d2-f4f8-4458-8df6-c03efd61e05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.880570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f51d2-f4f8-4458-8df6-c03efd61e05b admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.880894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f51d2-f4f8-4458-8df6-c03efd61e05b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.882312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f51d2-f4f8-4458-8df6-c03efd61e05b admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.883109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f51d2-f4f8-4458-8df6-c03efd61e05b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.885692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f51d2-f4f8-4458-8df6-c03efd61e05b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.900477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-9dab4c54-32d8-47bf-8b04-a888a4f5e6c8 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:02.903068 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9dab4c54-32d8-47bf-8b04-a888a4f5e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:02.914501 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 916/1851] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:51:02.915921 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 936/1852] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:02 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:02.920431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab4c54-32d8-47bf-8b04-a888a4f5e6c8 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.922501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5025d4-2df0-4529-be71-4a05c5e216f2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.923071 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5025d4-2df0-4529-be71-4a05c5e216f2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.924226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5025d4-2df0-4529-be71-4a05c5e216f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.925053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9dab4c54-32d8-47bf-8b04-a888a4f5e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:02.945020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab4c54-32d8-47bf-8b04-a888a4f5e6c8 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.951017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-3f5025d4-2df0-4529-be71-4a05c5e216f2 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:02.952267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403dac0-561a-4d93-8e11-02a838e687e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.952571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3f5025d4-2df0-4529-be71-4a05c5e216f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:02.953455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403dac0-561a-4d93-8e11-02a838e687e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.953750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403dac0-561a-4d93-8e11-02a838e687e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.954021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403dac0-561a-4d93-8e11-02a838e687e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.955018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403dac0-561a-4d93-8e11-02a838e687e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.957528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403dac0-561a-4d93-8e11-02a838e687e2 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:02.965018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 937/1853] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:02.967371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5025d4-2df0-4529-be71-4a05c5e216f2 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.980375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 917/1854] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:02.981497 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5025d4-2df0-4529-be71-4a05c5e216f2 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:02.983044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403dac0-561a-4d93-8e11-02a838e687e2 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:02.989117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980a68a-6fc3-416f-b452-879bdaf05a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:02.989813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a68a-6fc3-416f-b452-879bdaf05a3a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:02.993242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a68a-6fc3-416f-b452-879bdaf05a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:02.993242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a68a-6fc3-416f-b452-879bdaf05a3a admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:02.993242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980a68a-6fc3-416f-b452-879bdaf05a3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:02.993526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980a68a-6fc3-416f-b452-879bdaf05a3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:02.998851 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980a68a-6fc3-416f-b452-879bdaf05a3a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:03.005438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403dac0-561a-4d93-8e11-02a838e687e2 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:03.020166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7d039-089c-40f8-a243-ba2d24df3203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:03.020923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7d039-089c-40f8-a243-ba2d24df3203 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:03.021868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7d039-089c-40f8-a243-ba2d24df3203 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:03.023718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7d039-089c-40f8-a243-ba2d24df3203 admin admin] PATH_INFO: `/v3/projects/09c44e26f13a4312bd53c7ee433f05df/users/8a86289b7f964bf99984d8141e4a674a/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:03.039632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 938/1855] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:51:03.041518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980a68a-6fc3-416f-b452-879bdaf05a3a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:03.062297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980a68a-6fc3-416f-b452-879bdaf05a3a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:03.065695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7d039-089c-40f8-a243-ba2d24df3203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c44e26f13a4312bd53c7ee433f05df, user_id=8a86289b7f964bf99984d8141e4a674a, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:03.071894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7d039-089c-40f8-a243-ba2d24df3203 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:03.080643 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d36df8-2332-4ffd-9217-8ec846509a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:03.082307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36df8-2332-4ffd-9217-8ec846509a3f admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:03.083084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36df8-2332-4ffd-9217-8ec846509a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:03.084585 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36df8-2332-4ffd-9217-8ec846509a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:03.084713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d36df8-2332-4ffd-9217-8ec846509a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:03.087207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d36df8-2332-4ffd-9217-8ec846509a3f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:03.105009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 918/1856] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:02 2022] PUT /identity/v3/projects/09c44e26f13a4312bd53c7ee433f05df/users/8a86289b7f964bf99984d8141e4a674a/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:03.106102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7d039-089c-40f8-a243-ba2d24df3203 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:03.143560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 939/1857] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:03 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:03.144972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d36df8-2332-4ffd-9217-8ec846509a3f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:03.184334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:03.225410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7d039-089c-40f8-a243-ba2d24df3203 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:03.266586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d36df8-2332-4ffd-9217-8ec846509a3f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:03.289051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb4ec9-3bd3-43fe-b9ff-9d04e3e3aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:03.289598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb4ec9-3bd3-43fe-b9ff-9d04e3e3aeca admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:03.289884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb4ec9-3bd3-43fe-b9ff-9d04e3e3aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:03.290360 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb4ec9-3bd3-43fe-b9ff-9d04e3e3aeca admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:03.292099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb4ec9-3bd3-43fe-b9ff-9d04e3e3aeca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:03.294400 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb4ec9-3bd3-43fe-b9ff-9d04e3e3aeca admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:03.304193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022d9de-ac03-407d-812f-defb154249a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:03.304864 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022d9de-ac03-407d-812f-defb154249a4 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:03.305331 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022d9de-ac03-407d-812f-defb154249a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:03.305615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022d9de-ac03-407d-812f-defb154249a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:03.306450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022d9de-ac03-407d-812f-defb154249a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:03.309359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022d9de-ac03-407d-812f-defb154249a4 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:03.324132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 919/1858] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:03.329878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022d9de-ac03-407d-812f-defb154249a4 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:03.338822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 940/1859] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:03 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:51:03.342954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb4ec9-3bd3-43fe-b9ff-9d04e3e3aeca admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:03.356516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022d9de-ac03-407d-812f-defb154249a4 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:03.365592 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb4ec9-3bd3-43fe-b9ff-9d04e3e3aeca admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:03.366984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2515b-23eb-4bfe-b9ee-a30a0348ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:03.367960 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2515b-23eb-4bfe-b9ee-a30a0348ea35 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:03.368468 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2515b-23eb-4bfe-b9ee-a30a0348ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:03.368810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2515b-23eb-4bfe-b9ee-a30a0348ea35 admin admin] PATH_INFO: `/v3/projects/09c44e26f13a4312bd53c7ee433f05df/users/8a86289b7f964bf99984d8141e4a674a/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:03.371046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2515b-23eb-4bfe-b9ee-a30a0348ea35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c44e26f13a4312bd53c7ee433f05df, user_id=8a86289b7f964bf99984d8141e4a674a, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:03.373124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82d639-e52d-481a-a2ee-b7a5b3bb2abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:03.373821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82d639-e52d-481a-a2ee-b7a5b3bb2abf admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:03.374206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82d639-e52d-481a-a2ee-b7a5b3bb2abf admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:03.374783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82d639-e52d-481a-a2ee-b7a5b3bb2abf admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:03.375248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2515b-23eb-4bfe-b9ee-a30a0348ea35 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:03.375675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82d639-e52d-481a-a2ee-b7a5b3bb2abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:03.377513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82d639-e52d-481a-a2ee-b7a5b3bb2abf admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:03.399546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 920/1860] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:03 2022] PUT /identity/v3/projects/09c44e26f13a4312bd53c7ee433f05df/users/8a86289b7f964bf99984d8141e4a674a/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:03.400395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 941/1861] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:03.401406 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2515b-23eb-4bfe-b9ee-a30a0348ea35 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:03.402630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac0a9-0668-47cf-9c5b-e278474c2bd6 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:03.403881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac0a9-0668-47cf-9c5b-e278474c2bd6 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:03.404402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac0a9-0668-47cf-9c5b-e278474c2bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:03.493878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:03.504917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-3d5ac0a9-0668-47cf-9c5b-e278474c2bd6 None None] MFA Rules not processed for user `8a86289b7f964bf99984d8141e4a674a`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:03.506246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3d5ac0a9-0668-47cf-9c5b-e278474c2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:03.532643 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2515b-23eb-4bfe-b9ee-a30a0348ea35 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:03.553708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ce36-14a6-4290-ad7a-4ab4b440aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:03.554873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ce36-14a6-4290-ad7a-4ab4b440aa64 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:03.555149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ce36-14a6-4290-ad7a-4ab4b440aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:03.555447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ce36-14a6-4290-ad7a-4ab4b440aa64 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:03.556104 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714ce36-14a6-4290-ad7a-4ab4b440aa64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:03.557805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714ce36-14a6-4290-ad7a-4ab4b440aa64 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:03.601449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 921/1862] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:03.603602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ce36-14a6-4290-ad7a-4ab4b440aa64 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:03.624720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ce36-14a6-4290-ad7a-4ab4b440aa64 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:03.633879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9666a0c-61b7-430e-a43c-21a39b85a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:03.635150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9666a0c-61b7-430e-a43c-21a39b85a4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:03.637459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9666a0c-61b7-430e-a43c-21a39b85a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:03.637846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9666a0c-61b7-430e-a43c-21a39b85a4e4 admin admin] PATH_INFO: `/v3/projects/005f5ab56a4143a9b21b7fd037a5246e/users/33aeb68f572249539823989aff31cec9/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:03.662255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9666a0c-61b7-430e-a43c-21a39b85a4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005f5ab56a4143a9b21b7fd037a5246e, user_id=33aeb68f572249539823989aff31cec9, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:03.667089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9666a0c-61b7-430e-a43c-21a39b85a4e4 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:03.687132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 922/1863] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:03 2022] PUT /identity/v3/projects/005f5ab56a4143a9b21b7fd037a5246e/users/33aeb68f572249539823989aff31cec9/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:03.700170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bd2e0-a533-4a89-a7cf-fbe6cb5538f4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:03.700732 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bd2e0-a533-4a89-a7cf-fbe6cb5538f4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:03.701306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bd2e0-a533-4a89-a7cf-fbe6cb5538f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:03.703817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 942/1864] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:03.718352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ac0a9-0668-47cf-9c5b-e278474c2bd6 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:03.723345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3d5ac0a9-0668-47cf-9c5b-e278474c2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:03.783026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ec5bd2e0-a533-4a89-a7cf-fbe6cb5538f4 None None] MFA Rules not processed for user `33aeb68f572249539823989aff31cec9`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:03.784369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ec5bd2e0-a533-4a89-a7cf-fbe6cb5538f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:03.910089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ac0a9-0668-47cf-9c5b-e278474c2bd6 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:03.930975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 923/1865] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:03.937213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bd2e0-a533-4a89-a7cf-fbe6cb5538f4 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:04.026325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:04.095891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c648b5-4f24-4039-bfef-7fa9648c68b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:04.100003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c648b5-4f24-4039-bfef-7fa9648c68b7 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:04.100451 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c648b5-4f24-4039-bfef-7fa9648c68b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:04.103676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c648b5-4f24-4039-bfef-7fa9648c68b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:04.111460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-61c648b5-4f24-4039-bfef-7fa9648c68b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:04.118815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bd2e0-a533-4a89-a7cf-fbe6cb5538f4 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:04.128471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559243d-3356-4f24-b577-52c59a7fbcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:04.129441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559243d-3356-4f24-b577-52c59a7fbcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:04.129898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559243d-3356-4f24-b577-52c59a7fbcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:04.130176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559243d-3356-4f24-b577-52c59a7fbcf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:04.131085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559243d-3356-4f24-b577-52c59a7fbcf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:04.133485 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559243d-3356-4f24-b577-52c59a7fbcf5 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:04.189223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 924/1866] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:03 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:04.190912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559243d-3356-4f24-b577-52c59a7fbcf5 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:04.269986 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c648b5-4f24-4039-bfef-7fa9648c68b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:04.271596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c648b5-4f24-4039-bfef-7fa9648c68b7 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:04.275569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:04.292133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 943/1867] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:04.313099 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559243d-3356-4f24-b577-52c59a7fbcf5 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:04.319746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235680d-16fe-4178-b6f0-e90f1e26f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:04.320592 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235680d-16fe-4178-b6f0-e90f1e26f9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:04.321023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235680d-16fe-4178-b6f0-e90f1e26f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:04.321471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235680d-16fe-4178-b6f0-e90f1e26f9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:04.322121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235680d-16fe-4178-b6f0-e90f1e26f9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:04.324182 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235680d-16fe-4178-b6f0-e90f1e26f9b6 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:04.356012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 925/1868] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:04 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:04.356830 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c648b5-4f24-4039-bfef-7fa9648c68b7 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:04.371678 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c648b5-4f24-4039-bfef-7fa9648c68b7 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:04.380046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa892e-0fd8-45c4-9717-00b66b44ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:04.381215 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa892e-0fd8-45c4-9717-00b66b44ded3 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:04.382298 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa892e-0fd8-45c4-9717-00b66b44ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:04.383431 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa892e-0fd8-45c4-9717-00b66b44ded3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:04.385242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa892e-0fd8-45c4-9717-00b66b44ded3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:04.387703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa892e-0fd8-45c4-9717-00b66b44ded3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:04.408723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235680d-16fe-4178-b6f0-e90f1e26f9b6 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:04.409448 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 944/1869] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:51:04.425836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235680d-16fe-4178-b6f0-e90f1e26f9b6 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:04.431180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14183c1-d713-400c-8536-a57d72ef7b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:04.431853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14183c1-d713-400c-8536-a57d72ef7b88 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:04.432139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14183c1-d713-400c-8536-a57d72ef7b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:04.432602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14183c1-d713-400c-8536-a57d72ef7b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:04.433320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14183c1-d713-400c-8536-a57d72ef7b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:04.438515 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14183c1-d713-400c-8536-a57d72ef7b88 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:04.459258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa892e-0fd8-45c4-9717-00b66b44ded3 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:04.465332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 926/1870] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:51:04.478855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa892e-0fd8-45c4-9717-00b66b44ded3 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:04.487157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b5db6-fb1f-4c65-bc58-94f99611e5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:04.487880 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b5db6-fb1f-4c65-bc58-94f99611e5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:04.488161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b5db6-fb1f-4c65-bc58-94f99611e5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:04.488590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b5db6-fb1f-4c65-bc58-94f99611e5f6 admin admin] PATH_INFO: `/v3/projects/5ca3cbb8df49401a9948b8147d2e2b0a/users/e2331570ddfe44bc88948e19cb838666/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:04.514240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b5db6-fb1f-4c65-bc58-94f99611e5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca3cbb8df49401a9948b8147d2e2b0a, user_id=e2331570ddfe44bc88948e19cb838666, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:04.517702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b5db6-fb1f-4c65-bc58-94f99611e5f6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:04.541341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 945/1871] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:04 2022] PUT /identity/v3/projects/5ca3cbb8df49401a9948b8147d2e2b0a/users/e2331570ddfe44bc88948e19cb838666/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:04.553300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a03c-e090-4796-bb5b-02aaae959513 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:04.553807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a03c-e090-4796-bb5b-02aaae959513 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:04.554229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a03c-e090-4796-bb5b-02aaae959513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:04.615320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-7459a03c-e090-4796-bb5b-02aaae959513 None None] MFA Rules not processed for user `e2331570ddfe44bc88948e19cb838666`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:04.617374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-7459a03c-e090-4796-bb5b-02aaae959513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:04.750797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b5db6-fb1f-4c65-bc58-94f99611e5f6 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:04.751235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 927/1872] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:04.970099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b5db6-fb1f-4c65-bc58-94f99611e5f6 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:04.987569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb6400-ff6f-4ede-b239-c92261610db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:04.988395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6400-ff6f-4ede-b239-c92261610db4 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:04.988677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6400-ff6f-4ede-b239-c92261610db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:04.988954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6400-ff6f-4ede-b239-c92261610db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:04.989598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb6400-ff6f-4ede-b239-c92261610db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:05.001394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb6400-ff6f-4ede-b239-c92261610db4 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:05.071969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 946/1873] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:04 2022] POST /identity/v3/projects => generated 383 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:05.076110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459a03c-e090-4796-bb5b-02aaae959513 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:05.101261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459a03c-e090-4796-bb5b-02aaae959513 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:05.294488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f599b-93f3-4560-9520-0934410d987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:05.295124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f599b-93f3-4560-9520-0934410d987a admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:05.295445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f599b-93f3-4560-9520-0934410d987a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:05.295723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f599b-93f3-4560-9520-0934410d987a admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:05.296384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f599b-93f3-4560-9520-0934410d987a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:05.298322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f599b-93f3-4560-9520-0934410d987a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:05.373648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 928/1874] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:05 2022] POST /identity/v3/users => generated 298 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:05.377420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb6400-ff6f-4ede-b239-c92261610db4 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:05.396625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb6400-ff6f-4ede-b239-c92261610db4 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:05.403523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35435c-197e-42ec-b486-9a3b45a4f68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:05.405169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35435c-197e-42ec-b486-9a3b45a4f68b admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:05.405653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35435c-197e-42ec-b486-9a3b45a4f68b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:05.406073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35435c-197e-42ec-b486-9a3b45a4f68b admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:05.407050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35435c-197e-42ec-b486-9a3b45a4f68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:05.409137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35435c-197e-42ec-b486-9a3b45a4f68b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:05.443572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 947/1875] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:05.451543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f599b-93f3-4560-9520-0934410d987a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:05.466229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f599b-93f3-4560-9520-0934410d987a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:05.478367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b922-96ad-45b3-862e-66753a98470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:05.478367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b922-96ad-45b3-862e-66753a98470b admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:05.478367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b922-96ad-45b3-862e-66753a98470b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:05.478367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b922-96ad-45b3-862e-66753a98470b admin admin] PATH_INFO: `/v3/projects/cfaa30507dd8402496f854b299ce9c37/users/4da3f53958ef40ec982cfd0eb5dc5096/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:05.503555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4b922-96ad-45b3-862e-66753a98470b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfaa30507dd8402496f854b299ce9c37, user_id=4da3f53958ef40ec982cfd0eb5dc5096, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:05.507843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4b922-96ad-45b3-862e-66753a98470b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:05.538305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 929/1876] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:05 2022] PUT /identity/v3/projects/cfaa30507dd8402496f854b299ce9c37/users/4da3f53958ef40ec982cfd0eb5dc5096/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:05.539146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35435c-197e-42ec-b486-9a3b45a4f68b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:05.550297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35435c-197e-42ec-b486-9a3b45a4f68b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:05.607043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:05.657040 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa560195-ad28-43a1-b1b6-1777d6907ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:05.658783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa560195-ad28-43a1-b1b6-1777d6907ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:05.659248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa560195-ad28-43a1-b1b6-1777d6907ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:05.659696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa560195-ad28-43a1-b1b6-1777d6907ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:05.660504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa560195-ad28-43a1-b1b6-1777d6907ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:05.663481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa560195-ad28-43a1-b1b6-1777d6907ef1 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:05.688136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b922-96ad-45b3-862e-66753a98470b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:05.695137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 948/1877] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:05.701861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b922-96ad-45b3-862e-66753a98470b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:05.714618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53060333-b63e-46fd-99a5-58c8f6ff8cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:05.715487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060333-b63e-46fd-99a5-58c8f6ff8cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:05.715934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060333-b63e-46fd-99a5-58c8f6ff8cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:05.716593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060333-b63e-46fd-99a5-58c8f6ff8cb7 admin admin] PATH_INFO: `/v3/projects/cfaa30507dd8402496f854b299ce9c37/users/4da3f53958ef40ec982cfd0eb5dc5096/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:05.719811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53060333-b63e-46fd-99a5-58c8f6ff8cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfaa30507dd8402496f854b299ce9c37, user_id=4da3f53958ef40ec982cfd0eb5dc5096, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:05.723776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53060333-b63e-46fd-99a5-58c8f6ff8cb7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:05.731493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:05.773329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce462f7f-1be9-4a6e-ac70-721e1994f700 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:05.773329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce462f7f-1be9-4a6e-ac70-721e1994f700 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:05.773329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce462f7f-1be9-4a6e-ac70-721e1994f700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:05.773721 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 930/1878] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:05 2022] PUT /identity/v3/projects/cfaa30507dd8402496f854b299ce9c37/users/4da3f53958ef40ec982cfd0eb5dc5096/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:05.804954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-ce462f7f-1be9-4a6e-ac70-721e1994f700 None None] MFA Rules not processed for user `4da3f53958ef40ec982cfd0eb5dc5096`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:05.806892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ce462f7f-1be9-4a6e-ac70-721e1994f700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:05.936029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 949/1879] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:05.949445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53060333-b63e-46fd-99a5-58c8f6ff8cb7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:06.041730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53060333-b63e-46fd-99a5-58c8f6ff8cb7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:06.045836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6b23e-3e25-41e0-b600-43ba3e3d3814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:06.046467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6b23e-3e25-41e0-b600-43ba3e3d3814 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:06.046759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6b23e-3e25-41e0-b600-43ba3e3d3814 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:06.047036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6b23e-3e25-41e0-b600-43ba3e3d3814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:06.152421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6b23e-3e25-41e0-b600-43ba3e3d3814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:06.155575 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6b23e-3e25-41e0-b600-43ba3e3d3814 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:06.166982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 931/1880] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:51:08.578028 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e212e2f-68b7-4efd-aab9-0b636a412d09 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:08.578507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e212e2f-68b7-4efd-aab9-0b636a412d09 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:08.578588 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e212e2f-68b7-4efd-aab9-0b636a412d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:08.621958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-4e212e2f-68b7-4efd-aab9-0b636a412d09 None None] MFA Rules not processed for user `9a4d6e13f6d442de9dad4d420c2dc795`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:08.623790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4e212e2f-68b7-4efd-aab9-0b636a412d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:08.764043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 950/1881] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:51:08.780123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6b23e-3e25-41e0-b600-43ba3e3d3814 service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:08.782324 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9dc6b23e-3e25-41e0-b600-43ba3e3d3814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:08.873990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6b23e-3e25-41e0-b600-43ba3e3d3814 service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:08.879215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a3224-a94c-4eb0-9d13-a7832867dbeb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c894579b2b2943409412afbbfe779aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:08.880095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a3224-a94c-4eb0-9d13-a7832867dbeb service glance] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:08.881778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a3224-a94c-4eb0-9d13-a7832867dbeb service glance] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:08.882244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a3224-a94c-4eb0-9d13-a7832867dbeb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:08.886793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-519a3224-a94c-4eb0-9d13-a7832867dbeb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:08.994898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a3224-a94c-4eb0-9d13-a7832867dbeb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:09.008119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a3224-a94c-4eb0-9d13-a7832867dbeb service glance] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:09.022733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 932/1882] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:09.179309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0773-50ed-498d-b1ba-ea750720d73f None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:09.187144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0773-50ed-498d-b1ba-ea750720d73f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:09.187144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0773-50ed-498d-b1ba-ea750720d73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:09.203327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-61ca0773-50ed-498d-b1ba-ea750720d73f None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:09.203327 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-61ca0773-50ed-498d-b1ba-ea750720d73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:09.236139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a3224-a94c-4eb0-9d13-a7832867dbeb service glance] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:09.240902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-519a3224-a94c-4eb0-9d13-a7832867dbeb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:09.257827 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:09.272165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a3224-a94c-4eb0-9d13-a7832867dbeb service glance] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:09.275440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:09.288480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d623ce-2adc-4a05-bcc9-63ad389d23ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:09.289363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d623ce-2adc-4a05-bcc9-63ad389d23ea service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:09.290241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d623ce-2adc-4a05-bcc9-63ad389d23ea service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:09.290241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d623ce-2adc-4a05-bcc9-63ad389d23ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:09.307865 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 951/1883] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:51:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:09.331152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca0773-50ed-498d-b1ba-ea750720d73f None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:09.333087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-61ca0773-50ed-498d-b1ba-ea750720d73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:09.375061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d623ce-2adc-4a05-bcc9-63ad389d23ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:09.376869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d623ce-2adc-4a05-bcc9-63ad389d23ea service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:09.388924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 933/1884] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:51:09.421192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca0773-50ed-498d-b1ba-ea750720d73f None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:09.429800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e3636-8bda-46e6-bfa6-a66e82bd8155 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:09.430587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e3636-8bda-46e6-bfa6-a66e82bd8155 service swift] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:09.431085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e3636-8bda-46e6-bfa6-a66e82bd8155 service swift] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:09.431645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e3636-8bda-46e6-bfa6-a66e82bd8155 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:09.449088 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e3636-8bda-46e6-bfa6-a66e82bd8155 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:09.450820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e3636-8bda-46e6-bfa6-a66e82bd8155 service swift] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:09.461657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 952/1885] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:51:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 04:51:09.491250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d623ce-2adc-4a05-bcc9-63ad389d23ea service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:09.510087 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d623ce-2adc-4a05-bcc9-63ad389d23ea service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:09.521419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cbd94-7194-4900-b3f8-47072bb5376e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:09.522110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cbd94-7194-4900-b3f8-47072bb5376e service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:09.522399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cbd94-7194-4900-b3f8-47072bb5376e service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:09.522676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cbd94-7194-4900-b3f8-47072bb5376e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:09.670183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cbd94-7194-4900-b3f8-47072bb5376e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:09.671836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cbd94-7194-4900-b3f8-47072bb5376e service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:09.695061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 934/1886] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:10.485602 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e3636-8bda-46e6-bfa6-a66e82bd8155 service swift] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:10.497654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e3636-8bda-46e6-bfa6-a66e82bd8155 service swift] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:10.503441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23e9ec-3370-4de4-b4c4-2a5a7a034efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:10.504394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23e9ec-3370-4de4-b4c4-2a5a7a034efc service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:10.504653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23e9ec-3370-4de4-b4c4-2a5a7a034efc service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:10.505104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23e9ec-3370-4de4-b4c4-2a5a7a034efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:10.521117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23e9ec-3370-4de4-b4c4-2a5a7a034efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:10.524747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23e9ec-3370-4de4-b4c4-2a5a7a034efc service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:10.554450 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 953/1887] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:15.405236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cbd94-7194-4900-b3f8-47072bb5376e service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:15.618546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cbd94-7194-4900-b3f8-47072bb5376e service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:15.620638 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23e9ec-3370-4de4-b4c4-2a5a7a034efc service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:15.638074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23e9ec-3370-4de4-b4c4-2a5a7a034efc service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:15.642285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:15.643157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:15.646174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:15.646395 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] PATH_INFO: `/v3/users/304a5e03096e4ec9a683127fa7ad0f05` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:15.654487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] RBAC: Authorizing `identity:delete_user(user_id=304a5e03096e4ec9a683127fa7ad0f05)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:15.664408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:15.671154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:15.673238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:15.673923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:15.675316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] PATH_INFO: `/v3/users/33aeb68f572249539823989aff31cec9` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:15.687029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33aeb68f572249539823989aff31cec9)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:15.691588 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:15.819500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:15.830586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33aeb68f572249539823989aff31cec9'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:15.845292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33aeb68f572249539823989aff31cec9'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:15.847803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33aeb68f572249539823989aff31cec9'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:15.850474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33aeb68f572249539823989aff31cec9'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:15.855152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304a5e03096e4ec9a683127fa7ad0f05'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:15.873419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c479d300-2eab-4059-b946-1e5eba132245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33aeb68f572249539823989aff31cec9'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:15.875402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304a5e03096e4ec9a683127fa7ad0f05'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:15.876298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304a5e03096e4ec9a683127fa7ad0f05'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:15.877343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304a5e03096e4ec9a683127fa7ad0f05'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:15.893162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fa9b90a6-6bb3-4867-808a-93a9dffef20f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304a5e03096e4ec9a683127fa7ad0f05'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:15.916415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 954/1888] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:15 2022] DELETE /identity/v3/users/33aeb68f572249539823989aff31cec9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:15.920690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd20e0-798c-43f3-a08f-d3385c98ec28 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:15.921210 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd20e0-798c-43f3-a08f-d3385c98ec28 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:15.921671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd20e0-798c-43f3-a08f-d3385c98ec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:15.954140 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 935/1889] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:15 2022] DELETE /identity/v3/users/304a5e03096e4ec9a683127fa7ad0f05 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:15.958730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a81db6-f91e-4b06-bd31-06ec26d64cf4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:15.959898 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a81db6-f91e-4b06-bd31-06ec26d64cf4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:15.960255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a81db6-f91e-4b06-bd31-06ec26d64cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:15.972543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-e6fd20e0-798c-43f3-a08f-d3385c98ec28 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:15.974196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e6fd20e0-798c-43f3-a08f-d3385c98ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:16.039486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:16.039723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-19a81db6-f91e-4b06-bd31-06ec26d64cf4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:16.042362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-19a81db6-f91e-4b06-bd31-06ec26d64cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:16.111563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 955/1890] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:51:16.259987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 936/1891] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:16.342261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd20e0-798c-43f3-a08f-d3385c98ec28 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:16.343519 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a81db6-f91e-4b06-bd31-06ec26d64cf4 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:16.346208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-19a81db6-f91e-4b06-bd31-06ec26d64cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:16.347183 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e6fd20e0-798c-43f3-a08f-d3385c98ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:16.527359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd20e0-798c-43f3-a08f-d3385c98ec28 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:16.532931 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530bf19-f641-429d-b03b-5211da111aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:16.533649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530bf19-f641-429d-b03b-5211da111aed service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:16.534006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530bf19-f641-429d-b03b-5211da111aed service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:16.534483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530bf19-f641-429d-b03b-5211da111aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:16.536668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a81db6-f91e-4b06-bd31-06ec26d64cf4 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:16.541912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba34735-af63-4481-862e-8b64f9b98987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:16.542657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34735-af63-4481-862e-8b64f9b98987 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:16.543010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34735-af63-4481-862e-8b64f9b98987 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:16.543384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba34735-af63-4481-862e-8b64f9b98987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:16.548885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530bf19-f641-429d-b03b-5211da111aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:16.550701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530bf19-f641-429d-b03b-5211da111aed service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:16.553461 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba34735-af63-4481-862e-8b64f9b98987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:16.555075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba34735-af63-4481-862e-8b64f9b98987 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:16.567009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 937/1892] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:16.569699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045435-1218-43ac-865e-98b88bc415a5 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:16.569997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045435-1218-43ac-865e-98b88bc415a5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:16.570300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045435-1218-43ac-865e-98b88bc415a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:16.579171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 956/1893] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:16.580083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530bf19-f641-429d-b03b-5211da111aed service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:16.582610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5530bf19-f641-429d-b03b-5211da111aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:16.592315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-3e045435-1218-43ac-865e-98b88bc415a5 None None] MFA Rules not processed for user `94fe5ae1c52648fc9507216f4ab8d240`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:16.593544 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-3e045435-1218-43ac-865e-98b88bc415a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:16.597462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530bf19-f641-429d-b03b-5211da111aed service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:16.602942 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:16.603872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:16.604594 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:16.605370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] PATH_INFO: `/v3/users/c34c56b8b5e148109c56f0a0b36352a6` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:16.607550 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34c56b8b5e148109c56f0a0b36352a6)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:16.610319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:16.703717 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 938/1894] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:16.751082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34c56b8b5e148109c56f0a0b36352a6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:16.764945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34c56b8b5e148109c56f0a0b36352a6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:16.765975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34c56b8b5e148109c56f0a0b36352a6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:16.766996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34c56b8b5e148109c56f0a0b36352a6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:16.777403 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34c56b8b5e148109c56f0a0b36352a6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:16.811158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 957/1895] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:16 2022] DELETE /identity/v3/users/c34c56b8b5e148109c56f0a0b36352a6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:16.816459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12116b-f279-4cb6-9f4e-394f48081a89 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:16.817012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12116b-f279-4cb6-9f4e-394f48081a89 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:16.817523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12116b-f279-4cb6-9f4e-394f48081a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:16.827403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:16.852769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5f12116b-f279-4cb6-9f4e-394f48081a89 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:16.854161 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5f12116b-f279-4cb6-9f4e-394f48081a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:16.945254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 939/1896] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:16.988149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:16.993695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:17.122548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:17.130632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486ca81-6e4e-4d23-a747-002e080447e9 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:17.138133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95e949-6483-4d67-bc0a-758ee8b5d945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:17.139377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e949-6483-4d67-bc0a-758ee8b5d945 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:17.140103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e949-6483-4d67-bc0a-758ee8b5d945 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:17.140577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e949-6483-4d67-bc0a-758ee8b5d945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:17.182270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95e949-6483-4d67-bc0a-758ee8b5d945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:17.186188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95e949-6483-4d67-bc0a-758ee8b5d945 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:17.237837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12116b-f279-4cb6-9f4e-394f48081a89 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:17.239335 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5f12116b-f279-4cb6-9f4e-394f48081a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:17.243317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 958/1897] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:17.255088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12116b-f279-4cb6-9f4e-394f48081a89 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:17.269371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:17.270987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:17.271577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:17.271870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] PATH_INFO: `/v3/projects/005f5ab56a4143a9b21b7fd037a5246e` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:17.273485 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005f5ab56a4143a9b21b7fd037a5246e)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:17.291178 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:17.317024 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95e949-6483-4d67-bc0a-758ee8b5d945 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:17.320032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3d95e949-6483-4d67-bc0a-758ee8b5d945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:17.374717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95e949-6483-4d67-bc0a-758ee8b5d945 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:17.390191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:17.392575 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:17.393947 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:17.394697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] PATH_INFO: `/v3/projects/acb62324b8cc430994e00f59c874779f` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:17.398912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb62324b8cc430994e00f59c874779f)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:17.405473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:17.406078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005f5ab56a4143a9b21b7fd037a5246e', 'request_id': 'req-a46e7443-0910-4297-965c-eca2a827da56'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.416757 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005f5ab56a4143a9b21b7fd037a5246e', 'request_id': 'req-a46e7443-0910-4297-965c-eca2a827da56'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.437364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005f5ab56a4143a9b21b7fd037a5246e', 'request_id': 'req-a46e7443-0910-4297-965c-eca2a827da56'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.471128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] The token cache is being invalidate because project 005f5ab56a4143a9b21b7fd037a5246e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:17.472847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.476093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.480162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 940/1898] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:17 2022] DELETE /identity/v3/projects/005f5ab56a4143a9b21b7fd037a5246e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:17.484310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:17.486912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:17.548720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb62324b8cc430994e00f59c874779f', 'request_id': 'req-adcdc3fa-f68a-4501-891b-e7523afd81bb'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.569540 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb62324b8cc430994e00f59c874779f', 'request_id': 'req-adcdc3fa-f68a-4501-891b-e7523afd81bb'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.584499 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb62324b8cc430994e00f59c874779f', 'request_id': 'req-adcdc3fa-f68a-4501-891b-e7523afd81bb'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.613834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] The token cache is being invalidate because project acb62324b8cc430994e00f59c874779f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:17.614140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.616395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.624373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 959/1899] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:17 2022] DELETE /identity/v3/projects/acb62324b8cc430994e00f59c874779f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:17.626518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:17.630819 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:17.676383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7443-0910-4297-965c-eca2a827da56 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:17.746523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:17.813166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdc3fa-f68a-4501-891b-e7523afd81bb admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:17.817181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:17.817844 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:17.818158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:17.818947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] PATH_INFO: `/v3/users/e2331570ddfe44bc88948e19cb838666` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:17.821710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2331570ddfe44bc88948e19cb838666)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:17.829560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:17.831124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:17.832081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:17.832360 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:17.832642 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] PATH_INFO: `/v3/users/8a86289b7f964bf99984d8141e4a674a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:17.836409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a86289b7f964bf99984d8141e4a674a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:17.838956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:17.952704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2331570ddfe44bc88948e19cb838666'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.968341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2331570ddfe44bc88948e19cb838666'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.971822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a86289b7f964bf99984d8141e4a674a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.975332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2331570ddfe44bc88948e19cb838666'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.977335 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2331570ddfe44bc88948e19cb838666'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:17.997197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2331570ddfe44bc88948e19cb838666'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.008329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a86289b7f964bf99984d8141e4a674a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.009350 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a86289b7f964bf99984d8141e4a674a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.010006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a86289b7f964bf99984d8141e4a674a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.021162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a86289b7f964bf99984d8141e4a674a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.030223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 941/1900] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:17 2022] DELETE /identity/v3/users/e2331570ddfe44bc88948e19cb838666 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:18.045551 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:18.060922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 960/1901] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:17 2022] DELETE /identity/v3/users/8a86289b7f964bf99984d8141e4a674a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:18.082915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:18.090780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:18.268051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b23b-22e0-41ef-a90f-4f389f0971c7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:18.437028 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:18.438741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:18.439940 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:18.440237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] PATH_INFO: `/v3/projects/d99262a172794f1c8a4cc0acf91ffb98` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:18.446423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99262a172794f1c8a4cc0acf91ffb98)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:18.452812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:18.457298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:18.553370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99262a172794f1c8a4cc0acf91ffb98', 'request_id': 'req-116e7644-866c-4b83-8196-e7195668c92e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.571687 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99262a172794f1c8a4cc0acf91ffb98', 'request_id': 'req-116e7644-866c-4b83-8196-e7195668c92e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.613491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99262a172794f1c8a4cc0acf91ffb98', 'request_id': 'req-116e7644-866c-4b83-8196-e7195668c92e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.653089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] The token cache is being invalidate because project d99262a172794f1c8a4cc0acf91ffb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:18.653089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.655357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.659646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 942/1902] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:18 2022] DELETE /identity/v3/projects/d99262a172794f1c8a4cc0acf91ffb98 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:18.664114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:18.665845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:18.688243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9074f-0197-4526-8eb3-4af066464e86 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:18.713228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:18.714960 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:18.821663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:18.822469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:18.822856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:18.823238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] PATH_INFO: `/v3/users/0322bfcd289b4cc2a904c2c7b34d3741` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:18.825158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0322bfcd289b4cc2a904c2c7b34d3741)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:18.828406 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:18.893881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7644-866c-4b83-8196-e7195668c92e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:18.901036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:18.901686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:18.901969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:18.902244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] PATH_INFO: `/v3/projects/5ca3cbb8df49401a9948b8147d2e2b0a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:18.904147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca3cbb8df49401a9948b8147d2e2b0a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:18.906215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:18.952280 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0322bfcd289b4cc2a904c2c7b34d3741'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.970058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0322bfcd289b4cc2a904c2c7b34d3741'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.971524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0322bfcd289b4cc2a904c2c7b34d3741'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.972332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0322bfcd289b4cc2a904c2c7b34d3741'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.991562 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0322bfcd289b4cc2a904c2c7b34d3741'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:18.994505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca3cbb8df49401a9948b8147d2e2b0a', 'request_id': 'req-748fa385-0d8e-4996-9073-a34674fe4555'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.017297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca3cbb8df49401a9948b8147d2e2b0a', 'request_id': 'req-748fa385-0d8e-4996-9073-a34674fe4555'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.021719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 961/1903] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:18 2022] DELETE /identity/v3/users/0322bfcd289b4cc2a904c2c7b34d3741 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:19.021719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:19.021719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:19.035706 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca3cbb8df49401a9948b8147d2e2b0a', 'request_id': 'req-748fa385-0d8e-4996-9073-a34674fe4555'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.053682 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] The token cache is being invalidate because project 5ca3cbb8df49401a9948b8147d2e2b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:19.053986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.054768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.057333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 943/1904] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:18 2022] DELETE /identity/v3/projects/5ca3cbb8df49401a9948b8147d2e2b0a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:19.061077 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:19.063787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:19.122020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:19.183165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64098a-2a67-4e93-b602-fbce64070208 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:19.189083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:19.189844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:19.190201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:19.190551 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] PATH_INFO: `/v3/projects/09c44e26f13a4312bd53c7ee433f05df` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:19.191892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c44e26f13a4312bd53c7ee433f05df)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:19.194711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:19.215349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:19.240732 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa385-0d8e-4996-9073-a34674fe4555 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:19.253995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:19.255415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:19.257187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:19.257502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] PATH_INFO: `/v3/users/4da3f53958ef40ec982cfd0eb5dc5096` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:19.259630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da3f53958ef40ec982cfd0eb5dc5096)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:19.261847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:19.300074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c44e26f13a4312bd53c7ee433f05df', 'request_id': 'req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.324055 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c44e26f13a4312bd53c7ee433f05df', 'request_id': 'req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.338171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c44e26f13a4312bd53c7ee433f05df', 'request_id': 'req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.363805 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da3f53958ef40ec982cfd0eb5dc5096'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.364021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] The token cache is being invalidate because project 09c44e26f13a4312bd53c7ee433f05df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:19.364313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.365054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dbb91f52-4f1c-4386-834f-f8c4ba2bd3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.367603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 962/1905] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:19 2022] DELETE /identity/v3/projects/09c44e26f13a4312bd53c7ee433f05df => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:19.376225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1392b85-fd99-4f1b-b1aa-e9e9b653965a None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:19.376804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1392b85-fd99-4f1b-b1aa-e9e9b653965a None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:19.377170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1392b85-fd99-4f1b-b1aa-e9e9b653965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:19.378673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da3f53958ef40ec982cfd0eb5dc5096'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.379531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da3f53958ef40ec982cfd0eb5dc5096'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.380335 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da3f53958ef40ec982cfd0eb5dc5096'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.398581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cdf61c67-d721-42d8-bc2c-675de7932862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da3f53958ef40ec982cfd0eb5dc5096'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:19.412194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d1392b85-fd99-4f1b-b1aa-e9e9b653965a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:19.414304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d1392b85-fd99-4f1b-b1aa-e9e9b653965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:19.440622 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 944/1906] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:19 2022] DELETE /identity/v3/users/4da3f53958ef40ec982cfd0eb5dc5096 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:19.604584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 963/1907] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:19.621062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2061f-b763-4518-b6b6-1a11813ab2cd None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:19.622756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2061f-b763-4518-b6b6-1a11813ab2cd None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:19.625666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2061f-b763-4518-b6b6-1a11813ab2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:19.694842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1392b85-fd99-4f1b-b1aa-e9e9b653965a None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:19.696645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d1392b85-fd99-4f1b-b1aa-e9e9b653965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:19.718552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-19b2061f-b763-4518-b6b6-1a11813ab2cd None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:19.725821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-19b2061f-b763-4518-b6b6-1a11813ab2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:19.734881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1392b85-fd99-4f1b-b1aa-e9e9b653965a None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.003333 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.004645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.005635 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.006685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] PATH_INFO: `/v3/projects/2f480074383c4aa9a2ab80cc357e5027` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.013518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f480074383c4aa9a2ab80cc357e5027)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.015942 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.043353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 945/1908] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:20.051785 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2061f-b763-4518-b6b6-1a11813ab2cd None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.069195 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2061f-b763-4518-b6b6-1a11813ab2cd None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.075420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dceb12e-6666-451a-952f-daa7f2c513ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.076361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb12e-6666-451a-952f-daa7f2c513ce admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.080457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb12e-6666-451a-952f-daa7f2c513ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.081188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb12e-6666-451a-952f-daa7f2c513ce admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.083276 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dceb12e-6666-451a-952f-daa7f2c513ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:20.084768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dceb12e-6666-451a-952f-daa7f2c513ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.087949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dceb12e-6666-451a-952f-daa7f2c513ce admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.106126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 946/1909] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:51:20.110186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dceb12e-6666-451a-952f-daa7f2c513ce admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.129605 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dceb12e-6666-451a-952f-daa7f2c513ce admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.136751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d640-5c61-4d08-a98c-bceb21f5b05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.137676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d640-5c61-4d08-a98c-bceb21f5b05c admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.138117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d640-5c61-4d08-a98c-bceb21f5b05c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.138544 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d640-5c61-4d08-a98c-bceb21f5b05c admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.139361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07d640-5c61-4d08-a98c-bceb21f5b05c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.141499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07d640-5c61-4d08-a98c-bceb21f5b05c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.193645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 947/1910] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:20 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:20.195323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d640-5c61-4d08-a98c-bceb21f5b05c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.202752 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:20.203318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:20.212412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f480074383c4aa9a2ab80cc357e5027', 'request_id': 'req-dd5ab746-de40-4ad0-97c2-332d105a52ee'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:20.226160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f480074383c4aa9a2ab80cc357e5027', 'request_id': 'req-dd5ab746-de40-4ad0-97c2-332d105a52ee'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:20.234290 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f480074383c4aa9a2ab80cc357e5027', 'request_id': 'req-dd5ab746-de40-4ad0-97c2-332d105a52ee'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:20.260256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] The token cache is being invalidate because project 2f480074383c4aa9a2ab80cc357e5027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:20.260547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:20.262443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-dd5ab746-de40-4ad0-97c2-332d105a52ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:20.267625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 964/1911] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:19 2022] DELETE /identity/v3/projects/2f480074383c4aa9a2ab80cc357e5027 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:20.269234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c007-e44b-4a1b-b1f5-48ce6cc6e49e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.269680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c007-e44b-4a1b-b1f5-48ce6cc6e49e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.269964 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0c007-e44b-4a1b-b1f5-48ce6cc6e49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.300918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bcd0c007-e44b-4a1b-b1f5-48ce6cc6e49e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:20.302227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bcd0c007-e44b-4a1b-b1f5-48ce6cc6e49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:20.303495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d640-5c61-4d08-a98c-bceb21f5b05c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.310440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3589da-f58f-4e77-b54b-5769c5430951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.312331 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3589da-f58f-4e77-b54b-5769c5430951 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.312650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3589da-f58f-4e77-b54b-5769c5430951 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.312933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3589da-f58f-4e77-b54b-5769c5430951 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.313592 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3589da-f58f-4e77-b54b-5769c5430951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.316003 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3589da-f58f-4e77-b54b-5769c5430951 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.321315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 965/1912] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:20.322797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ecf3e-800a-4b80-ba3e-39d1a8532540 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.323272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ecf3e-800a-4b80-ba3e-39d1a8532540 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.323679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ecf3e-800a-4b80-ba3e-39d1a8532540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.362151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-f98ecf3e-800a-4b80-ba3e-39d1a8532540 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:20.363482 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f98ecf3e-800a-4b80-ba3e-39d1a8532540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:20.366723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 948/1913] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:20 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:20.367965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3589da-f58f-4e77-b54b-5769c5430951 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.371534 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-be3589da-f58f-4e77-b54b-5769c5430951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:20.374747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 966/1914] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:20.379191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ecf3e-800a-4b80-ba3e-39d1a8532540 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.391068 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ecf3e-800a-4b80-ba3e-39d1a8532540 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.398621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3589da-f58f-4e77-b54b-5769c5430951 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.402933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e996c0-96fe-4206-9bbc-fd554f8a424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.403764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e996c0-96fe-4206-9bbc-fd554f8a424f admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.403999 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e996c0-96fe-4206-9bbc-fd554f8a424f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.404350 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e996c0-96fe-4206-9bbc-fd554f8a424f admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.405011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e996c0-96fe-4206-9bbc-fd554f8a424f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:20.406008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e996c0-96fe-4206-9bbc-fd554f8a424f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.407508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e996c0-96fe-4206-9bbc-fd554f8a424f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.421386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b50d0-4b27-4da7-b716-34781c2abdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.422170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b50d0-4b27-4da7-b716-34781c2abdcf admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.422497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b50d0-4b27-4da7-b716-34781c2abdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.425105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b50d0-4b27-4da7-b716-34781c2abdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.425794 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b50d0-4b27-4da7-b716-34781c2abdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.430145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b50d0-4b27-4da7-b716-34781c2abdcf admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.441093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 967/1915] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:51:20.446800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e996c0-96fe-4206-9bbc-fd554f8a424f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.468992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 949/1916] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:20.468992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b50d0-4b27-4da7-b716-34781c2abdcf admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.468992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bd1b50d0-4b27-4da7-b716-34781c2abdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:20.473062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e996c0-96fe-4206-9bbc-fd554f8a424f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.479497 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1b511-73e3-4a0c-9014-ce774564aff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.480558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1b511-73e3-4a0c-9014-ce774564aff9 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.480810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1b511-73e3-4a0c-9014-ce774564aff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.481078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1b511-73e3-4a0c-9014-ce774564aff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.483841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b50d0-4b27-4da7-b716-34781c2abdcf admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.486606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1b511-73e3-4a0c-9014-ce774564aff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.488995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.489716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.490557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1b511-73e3-4a0c-9014-ce774564aff9 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.490687 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.491122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] PATH_INFO: `/v3/projects/cfaa30507dd8402496f854b299ce9c37` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.492858 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfaa30507dd8402496f854b299ce9c37)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.495375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.531454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 968/1917] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:20 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:20.532564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1b511-73e3-4a0c-9014-ce774564aff9 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.587411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfaa30507dd8402496f854b299ce9c37', 'request_id': 'req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:20.597280 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfaa30507dd8402496f854b299ce9c37', 'request_id': 'req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:20.607496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfaa30507dd8402496f854b299ce9c37', 'request_id': 'req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:20.622326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] The token cache is being invalidate because project cfaa30507dd8402496f854b299ce9c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:20.622752 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:20.624534 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:20.626524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 950/1918] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:20 2022] DELETE /identity/v3/projects/cfaa30507dd8402496f854b299ce9c37 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:20.627410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.634411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:20.676427 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1b511-73e3-4a0c-9014-ce774564aff9 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.769825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424875a6-8db6-4fd0-a19e-c9de5bab1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.770824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424875a6-8db6-4fd0-a19e-c9de5bab1ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.772083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424875a6-8db6-4fd0-a19e-c9de5bab1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.772599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424875a6-8db6-4fd0-a19e-c9de5bab1ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.775065 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424875a6-8db6-4fd0-a19e-c9de5bab1ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.778748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424875a6-8db6-4fd0-a19e-c9de5bab1ff4 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.794918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 969/1919] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:20.796853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96c156-8bbf-401d-8ca2-a9cc273c65d2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.798002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96c156-8bbf-401d-8ca2-a9cc273c65d2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.798509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96c156-8bbf-401d-8ca2-a9cc273c65d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.801280 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cbaa9-5977-446b-8ab5-76ca141fe6bd admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.812337 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eabc6-cdf5-41a5-ad1c-7d8b4c8c5b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.812973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eabc6-cdf5-41a5-ad1c-7d8b4c8c5b3b admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.813257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eabc6-cdf5-41a5-ad1c-7d8b4c8c5b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.813529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eabc6-cdf5-41a5-ad1c-7d8b4c8c5b3b admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.814169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8eabc6-cdf5-41a5-ad1c-7d8b4c8c5b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.816130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8eabc6-cdf5-41a5-ad1c-7d8b4c8c5b3b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.835459 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8b96c156-8bbf-401d-8ca2-a9cc273c65d2 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:20.836862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8b96c156-8bbf-401d-8ca2-a9cc273c65d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:20.848207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:20.863812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 951/1920] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:20 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:20.864689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eabc6-cdf5-41a5-ad1c-7d8b4c8c5b3b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.864802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 970/1921] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:20.868262 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4e8eabc6-cdf5-41a5-ad1c-7d8b4c8c5b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:20.870832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96c156-8bbf-401d-8ca2-a9cc273c65d2 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.882453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eabc6-cdf5-41a5-ad1c-7d8b4c8c5b3b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.882716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96c156-8bbf-401d-8ca2-a9cc273c65d2 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:20.890627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2e357-525a-4eb4-b143-f1dae5bee102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.891097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aa01b-7a7e-4b74-9a4b-a132da95be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:20.891239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2e357-525a-4eb4-b143-f1dae5bee102 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.891545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2e357-525a-4eb4-b143-f1dae5bee102 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.891810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2e357-525a-4eb4-b143-f1dae5bee102 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.891961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aa01b-7a7e-4b74-9a4b-a132da95be93 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.892374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aa01b-7a7e-4b74-9a4b-a132da95be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.892486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2e357-525a-4eb4-b143-f1dae5bee102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.892725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aa01b-7a7e-4b74-9a4b-a132da95be93 admin admin] PATH_INFO: `/v3/projects/436fde3212324a9d96d231a2cf0f02e0/users/5ea86f4e5dfa4c7c9127da0c4ff37f0e/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.894032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2e357-525a-4eb4-b143-f1dae5bee102 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.905754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 971/1922] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:20.906852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fadf1-e5aa-4e2f-9a38-d29f2bac874a None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:20.907235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fadf1-e5aa-4e2f-9a38-d29f2bac874a None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:20.907535 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fadf1-e5aa-4e2f-9a38-d29f2bac874a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:20.912715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aa01b-7a7e-4b74-9a4b-a132da95be93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436fde3212324a9d96d231a2cf0f02e0, user_id=5ea86f4e5dfa4c7c9127da0c4ff37f0e, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:20.915376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aa01b-7a7e-4b74-9a4b-a132da95be93 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:20.934577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 952/1923] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:20 2022] PUT /identity/v3/projects/436fde3212324a9d96d231a2cf0f02e0/users/5ea86f4e5dfa4c7c9127da0c4ff37f0e/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:20.936042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aa01b-7a7e-4b74-9a4b-a132da95be93 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:20.950371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-285fadf1-e5aa-4e2f-9a38-d29f2bac874a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:20.953249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-285fadf1-e5aa-4e2f-9a38-d29f2bac874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:20.961344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:21.032362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 972/1924] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:21.032362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5c40f-520c-4381-b085-74499a3e81aa None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.032362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5c40f-520c-4381-b085-74499a3e81aa None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.032362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5c40f-520c-4381-b085-74499a3e81aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.058496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aa01b-7a7e-4b74-9a4b-a132da95be93 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.065728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545e1c1-fe65-4ea1-89a0-f3714ada2bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.066352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545e1c1-fe65-4ea1-89a0-f3714ada2bce admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.066635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545e1c1-fe65-4ea1-89a0-f3714ada2bce admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.066911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545e1c1-fe65-4ea1-89a0-f3714ada2bce admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.067628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545e1c1-fe65-4ea1-89a0-f3714ada2bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.069874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545e1c1-fe65-4ea1-89a0-f3714ada2bce admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.079798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-1ea5c40f-520c-4381-b085-74499a3e81aa None None] MFA Rules not processed for user `5ea86f4e5dfa4c7c9127da0c4ff37f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:21.081181 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1ea5c40f-520c-4381-b085-74499a3e81aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:21.082609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 953/1925] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:21.083536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545e1c1-fe65-4ea1-89a0-f3714ada2bce admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.098004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545e1c1-fe65-4ea1-89a0-f3714ada2bce admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.105782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166cf05-985f-408b-a9a6-c1e5e21e3f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.109615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166cf05-985f-408b-a9a6-c1e5e21e3f38 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.109914 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166cf05-985f-408b-a9a6-c1e5e21e3f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.110193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166cf05-985f-408b-a9a6-c1e5e21e3f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.110861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166cf05-985f-408b-a9a6-c1e5e21e3f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:21.111168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166cf05-985f-408b-a9a6-c1e5e21e3f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.114573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166cf05-985f-408b-a9a6-c1e5e21e3f38 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.139802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 954/1926] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:51:21.139802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166cf05-985f-408b-a9a6-c1e5e21e3f38 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.153345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166cf05-985f-408b-a9a6-c1e5e21e3f38 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.163880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c9c8-8405-4ec1-95da-4d8b01bf5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.164667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c9c8-8405-4ec1-95da-4d8b01bf5552 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.164961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c9c8-8405-4ec1-95da-4d8b01bf5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.165242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c9c8-8405-4ec1-95da-4d8b01bf5552 admin admin] PATH_INFO: `/v3/projects/d0cd3c5646ff44098df7239ebe7937db/users/416b8f53d7ea4dfa80c6692586eb709b/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.191179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 973/1927] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:21.193868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5c40f-520c-4381-b085-74499a3e81aa None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.206025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5c40f-520c-4381-b085-74499a3e81aa None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.209663 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0c9c8-8405-4ec1-95da-4d8b01bf5552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cd3c5646ff44098df7239ebe7937db, user_id=416b8f53d7ea4dfa80c6692586eb709b, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.213223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0c9c8-8405-4ec1-95da-4d8b01bf5552 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.216385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cc614-73e8-413d-8dc6-cbaa046fcc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.218492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cc614-73e8-413d-8dc6-cbaa046fcc52 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.218997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cc614-73e8-413d-8dc6-cbaa046fcc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.220443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cc614-73e8-413d-8dc6-cbaa046fcc52 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.221294 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cc614-73e8-413d-8dc6-cbaa046fcc52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.223766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cc614-73e8-413d-8dc6-cbaa046fcc52 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.241336 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 955/1928] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:21 2022] PUT /identity/v3/projects/d0cd3c5646ff44098df7239ebe7937db/users/416b8f53d7ea4dfa80c6692586eb709b/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:21.251697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c9c8-8405-4ec1-95da-4d8b01bf5552 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.280456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 974/1929] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:21 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:21.281977 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a6a21-b019-4369-aafd-cc2ddf8f1394 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.282271 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a6a21-b019-4369-aafd-cc2ddf8f1394 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.282542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a6a21-b019-4369-aafd-cc2ddf8f1394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.319965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d25a6a21-b019-4369-aafd-cc2ddf8f1394 None None] MFA Rules not processed for user `416b8f53d7ea4dfa80c6692586eb709b`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:21.321084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d25a6a21-b019-4369-aafd-cc2ddf8f1394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:21.351879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c9c8-8405-4ec1-95da-4d8b01bf5552 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.402963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:21.445445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 975/1930] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:21.446218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a6a21-b019-4369-aafd-cc2ddf8f1394 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.467045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85031746-26c9-402b-8bb0-8b2d0c8ffd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.467717 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85031746-26c9-402b-8bb0-8b2d0c8ffd57 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.472033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85031746-26c9-402b-8bb0-8b2d0c8ffd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.472335 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85031746-26c9-402b-8bb0-8b2d0c8ffd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.473091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85031746-26c9-402b-8bb0-8b2d0c8ffd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.475170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85031746-26c9-402b-8bb0-8b2d0c8ffd57 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.477527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a6a21-b019-4369-aafd-cc2ddf8f1394 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.492230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3772e-e80c-4b2b-bd1e-c5b9a7479f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.492866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3772e-e80c-4b2b-bd1e-c5b9a7479f41 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.493145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3772e-e80c-4b2b-bd1e-c5b9a7479f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.493416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3772e-e80c-4b2b-bd1e-c5b9a7479f41 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.497466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3772e-e80c-4b2b-bd1e-c5b9a7479f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.501311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3772e-e80c-4b2b-bd1e-c5b9a7479f41 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.528806 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:21.553685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 956/1931] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:21 2022] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:21.557115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85031746-26c9-402b-8bb0-8b2d0c8ffd57 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.561998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 976/1932] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:21 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:21.562911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3772e-e80c-4b2b-bd1e-c5b9a7479f41 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.590439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3772e-e80c-4b2b-bd1e-c5b9a7479f41 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.698356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85031746-26c9-402b-8bb0-8b2d0c8ffd57 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.706407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99a552-507e-465c-a5cd-ed6eac5a89e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.707423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a552-507e-465c-a5cd-ed6eac5a89e0 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.707788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a552-507e-465c-a5cd-ed6eac5a89e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.708149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99a552-507e-465c-a5cd-ed6eac5a89e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.709733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99a552-507e-465c-a5cd-ed6eac5a89e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.712340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99a552-507e-465c-a5cd-ed6eac5a89e0 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.725463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e3f15-4ddd-4ba6-af11-12b1329f5ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.726411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3f15-4ddd-4ba6-af11-12b1329f5ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.726866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3f15-4ddd-4ba6-af11-12b1329f5ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.727314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3f15-4ddd-4ba6-af11-12b1329f5ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.728130 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e3f15-4ddd-4ba6-af11-12b1329f5ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.736587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e3f15-4ddd-4ba6-af11-12b1329f5ca9 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.756369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 957/1933] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:21 2022] POST /identity/v3/projects => generated 363 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:21.758622 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99a552-507e-465c-a5cd-ed6eac5a89e0 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.768832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 977/1934] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:21 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:21.770451 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e3f15-4ddd-4ba6-af11-12b1329f5ca9 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.792992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e3f15-4ddd-4ba6-af11-12b1329f5ca9 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.871747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99a552-507e-465c-a5cd-ed6eac5a89e0 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.879751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c7b47-4633-4644-87ab-75dd4bafa28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.881278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7b47-4633-4644-87ab-75dd4bafa28d admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.881569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7b47-4633-4644-87ab-75dd4bafa28d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.881849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7b47-4633-4644-87ab-75dd4bafa28d admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.884559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c7b47-4633-4644-87ab-75dd4bafa28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.886182 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c7b47-4633-4644-87ab-75dd4bafa28d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.906082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 958/1935] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:21.910444 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c6267-1408-469f-bce8-94dcb5b5c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.912292 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c7b47-4633-4644-87ab-75dd4bafa28d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.912709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6267-1408-469f-bce8-94dcb5b5c851 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.913121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6267-1408-469f-bce8-94dcb5b5c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.913494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6267-1408-469f-bce8-94dcb5b5c851 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.914234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c6267-1408-469f-bce8-94dcb5b5c851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.916775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c6267-1408-469f-bce8-94dcb5b5c851 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.947760 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 978/1936] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:21 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:21.949132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c6267-1408-469f-bce8-94dcb5b5c851 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:21.954188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c7b47-4633-4644-87ab-75dd4bafa28d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.962985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c6267-1408-469f-bce8-94dcb5b5c851 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:21.970246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a349f1b-45fe-45ef-ac11-b6d7b3f6d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.971249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a349f1b-45fe-45ef-ac11-b6d7b3f6d42a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.971703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a349f1b-45fe-45ef-ac11-b6d7b3f6d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.972080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a349f1b-45fe-45ef-ac11-b6d7b3f6d42a admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.973223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a349f1b-45fe-45ef-ac11-b6d7b3f6d42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.975427 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a349f1b-45fe-45ef-ac11-b6d7b3f6d42a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.983680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea7f28-553a-4df5-b388-06a2f3262a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:21.984361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea7f28-553a-4df5-b388-06a2f3262a48 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:21.984654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea7f28-553a-4df5-b388-06a2f3262a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:21.984945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea7f28-553a-4df5-b388-06a2f3262a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:21.986143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea7f28-553a-4df5-b388-06a2f3262a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:21.987815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea7f28-553a-4df5-b388-06a2f3262a48 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:21.992108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 979/1937] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:21.992108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a349f1b-45fe-45ef-ac11-b6d7b3f6d42a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.007420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a349f1b-45fe-45ef-ac11-b6d7b3f6d42a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.011622 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 959/1938] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:22.012559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea7f28-553a-4df5-b388-06a2f3262a48 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.015388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29383ff-1fb9-4b6b-bc19-d62fca0303f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.016138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29383ff-1fb9-4b6b-bc19-d62fca0303f6 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.016548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29383ff-1fb9-4b6b-bc19-d62fca0303f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.017008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29383ff-1fb9-4b6b-bc19-d62fca0303f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.018103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29383ff-1fb9-4b6b-bc19-d62fca0303f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:22.020694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29383ff-1fb9-4b6b-bc19-d62fca0303f6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:22.023671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea7f28-553a-4df5-b388-06a2f3262a48 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.034984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c20c3-6e07-482d-ae19-00c4e514fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.035719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c20c3-6e07-482d-ae19-00c4e514fef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.036156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 980/1939] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:22.037681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29383ff-1fb9-4b6b-bc19-d62fca0303f6 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.039260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c20c3-6e07-482d-ae19-00c4e514fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.039589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c20c3-6e07-482d-ae19-00c4e514fef7 admin admin] PATH_INFO: `/v3/projects/ac21b9ff3bd346eab235ebb4bbbb5b44/users/3fb107d2c1414da5a967ec95ffedb747/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.053235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29383ff-1fb9-4b6b-bc19-d62fca0303f6 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.059826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c0f23-5363-423b-9a5d-74c33c0b79f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.060592 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0f23-5363-423b-9a5d-74c33c0b79f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.061333 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0f23-5363-423b-9a5d-74c33c0b79f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.061743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0f23-5363-423b-9a5d-74c33c0b79f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.062091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c20c3-6e07-482d-ae19-00c4e514fef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac21b9ff3bd346eab235ebb4bbbb5b44, user_id=3fb107d2c1414da5a967ec95ffedb747, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:22.062583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c0f23-5363-423b-9a5d-74c33c0b79f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:22.064645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c0f23-5363-423b-9a5d-74c33c0b79f5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:22.064912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c20c3-6e07-482d-ae19-00c4e514fef7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:22.083239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 981/1940] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:22.085231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c0f23-5363-423b-9a5d-74c33c0b79f5 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.097716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c0f23-5363-423b-9a5d-74c33c0b79f5 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.110812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 960/1941] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:22 2022] PUT /identity/v3/projects/ac21b9ff3bd346eab235ebb4bbbb5b44/users/3fb107d2c1414da5a967ec95ffedb747/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:22.110812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c20c3-6e07-482d-ae19-00c4e514fef7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.123392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:22.142846 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:22.192295 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de4931-73db-455d-b8d3-454bf41ec344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.193042 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de4931-73db-455d-b8d3-454bf41ec344 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.195013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de4931-73db-455d-b8d3-454bf41ec344 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.195326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de4931-73db-455d-b8d3-454bf41ec344 admin admin] PATH_INFO: `/v3/projects/307caa9c5848478c91bedc0f7a91bbf6/users/97c74fba17e24561a719dc1849e89c02/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.208776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c20c3-6e07-482d-ae19-00c4e514fef7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.214135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d9721-5c5b-4636-8bfb-5a0fef7cb7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.215157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d9721-5c5b-4636-8bfb-5a0fef7cb7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.215568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d9721-5c5b-4636-8bfb-5a0fef7cb7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.215941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d9721-5c5b-4636-8bfb-5a0fef7cb7a8 admin admin] PATH_INFO: `/v3/projects/f0155c600bcc4a848ed07539af82c6f4/users/9fe1245d00244578a70c298d3b98faec/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.237801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d9721-5c5b-4636-8bfb-5a0fef7cb7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0155c600bcc4a848ed07539af82c6f4, user_id=9fe1245d00244578a70c298d3b98faec, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:22.244424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de4931-73db-455d-b8d3-454bf41ec344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307caa9c5848478c91bedc0f7a91bbf6, user_id=97c74fba17e24561a719dc1849e89c02, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:22.247116 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de4931-73db-455d-b8d3-454bf41ec344 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:22.252598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d9721-5c5b-4636-8bfb-5a0fef7cb7a8 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:22.279947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 961/1942] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:22 2022] PUT /identity/v3/projects/f0155c600bcc4a848ed07539af82c6f4/users/9fe1245d00244578a70c298d3b98faec/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:22.281063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 982/1943] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:22 2022] PUT /identity/v3/projects/307caa9c5848478c91bedc0f7a91bbf6/users/97c74fba17e24561a719dc1849e89c02/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:22.285343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d9721-5c5b-4636-8bfb-5a0fef7cb7a8 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.285956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf78ac-408f-44d6-83d1-b2462758231f None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.286256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf78ac-408f-44d6-83d1-b2462758231f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.286537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf78ac-408f-44d6-83d1-b2462758231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.341345 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-56bf78ac-408f-44d6-83d1-b2462758231f None None] MFA Rules not processed for user `3fb107d2c1414da5a967ec95ffedb747`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:22.342728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-56bf78ac-408f-44d6-83d1-b2462758231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:22.402717 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d9721-5c5b-4636-8bfb-5a0fef7cb7a8 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.484302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 983/1944] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:22.485683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5177e-9dd2-4118-a1ba-18d315d1aacf None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.486103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5177e-9dd2-4118-a1ba-18d315d1aacf None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.486404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5177e-9dd2-4118-a1ba-18d315d1aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.501850 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982d201-c57d-4681-894c-acebbcdf4f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.503130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d201-c57d-4681-894c-acebbcdf4f78 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.503639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d201-c57d-4681-894c-acebbcdf4f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.504070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d201-c57d-4681-894c-acebbcdf4f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.504804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982d201-c57d-4681-894c-acebbcdf4f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:22.506615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982d201-c57d-4681-894c-acebbcdf4f78 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:22.521630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 962/1945] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:22.523589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982d201-c57d-4681-894c-acebbcdf4f78 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.526136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f982d201-c57d-4681-894c-acebbcdf4f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:22.551568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-80e5177e-9dd2-4118-a1ba-18d315d1aacf None None] MFA Rules not processed for user `9fe1245d00244578a70c298d3b98faec`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:22.554063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-80e5177e-9dd2-4118-a1ba-18d315d1aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:22.605089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:22.629828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982d201-c57d-4681-894c-acebbcdf4f78 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.637269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ffce8-492a-4ea1-929b-aef7c53b1024 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c894579b2b2943409412afbbfe779aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.638039 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ffce8-492a-4ea1-929b-aef7c53b1024 service glance] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.638368 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ffce8-492a-4ea1-929b-aef7c53b1024 service glance] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.638651 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ffce8-492a-4ea1-929b-aef7c53b1024 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.650626 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ffce8-492a-4ea1-929b-aef7c53b1024 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:22.652268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ffce8-492a-4ea1-929b-aef7c53b1024 service glance] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:22.673159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 984/1946] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:22.673159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5177e-9dd2-4118-a1ba-18d315d1aacf None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.673674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 963/1947] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:22.676625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ffce8-492a-4ea1-929b-aef7c53b1024 service glance] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.684541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5177e-9dd2-4118-a1ba-18d315d1aacf None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.690626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cec9f3-6033-4f13-ae3e-d55a3042578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.691360 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cec9f3-6033-4f13-ae3e-d55a3042578f admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.691655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cec9f3-6033-4f13-ae3e-d55a3042578f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.694004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cec9f3-6033-4f13-ae3e-d55a3042578f admin admin] PATH_INFO: `/v3/projects/307caa9c5848478c91bedc0f7a91bbf6/users/97c74fba17e24561a719dc1849e89c02/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.695879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cec9f3-6033-4f13-ae3e-d55a3042578f admin admin] RBAC: Authorizing `identity:create_grant(project_id=307caa9c5848478c91bedc0f7a91bbf6, user_id=97c74fba17e24561a719dc1849e89c02, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:22.700486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cec9f3-6033-4f13-ae3e-d55a3042578f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:22.701295 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ffce8-492a-4ea1-929b-aef7c53b1024 service glance] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.707230 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b748b-9707-4aed-80a0-32c904cc9664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.708124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b748b-9707-4aed-80a0-32c904cc9664 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.708632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b748b-9707-4aed-80a0-32c904cc9664 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.709122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b748b-9707-4aed-80a0-32c904cc9664 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.710457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b748b-9707-4aed-80a0-32c904cc9664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:22.712904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b748b-9707-4aed-80a0-32c904cc9664 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:22.715842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 985/1948] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:22 2022] PUT /identity/v3/projects/307caa9c5848478c91bedc0f7a91bbf6/users/97c74fba17e24561a719dc1849e89c02/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:22.726394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d281ec-9a62-44f4-aeff-b75c97d8b3ad None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.726718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d281ec-9a62-44f4-aeff-b75c97d8b3ad None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.726952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d281ec-9a62-44f4-aeff-b75c97d8b3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.751884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 964/1949] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:22 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:22.753979 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b748b-9707-4aed-80a0-32c904cc9664 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.799322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c2d281ec-9a62-44f4-aeff-b75c97d8b3ad None None] MFA Rules not processed for user `97c74fba17e24561a719dc1849e89c02`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:22.808228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c2d281ec-9a62-44f4-aeff-b75c97d8b3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:22.838978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:22.865901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b748b-9707-4aed-80a0-32c904cc9664 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.877809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7369d-090e-41dc-ab45-bb5baeafe884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.878500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7369d-090e-41dc-ab45-bb5baeafe884 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.878705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7369d-090e-41dc-ab45-bb5baeafe884 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.878984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7369d-090e-41dc-ab45-bb5baeafe884 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.879644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7369d-090e-41dc-ab45-bb5baeafe884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:22.887103 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7369d-090e-41dc-ab45-bb5baeafe884 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:22.955228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 965/1950] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:22 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:22.958950 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7369d-090e-41dc-ab45-bb5baeafe884 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.974869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 986/1951] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:22.980417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7369d-090e-41dc-ab45-bb5baeafe884 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:22.986859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d281ec-9a62-44f4-aeff-b75c97d8b3ad None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:22.988833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c2d281ec-9a62-44f4-aeff-b75c97d8b3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:22.994966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1dabd-4ed0-42bb-83ef-67ca67c846e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:22.996042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1dabd-4ed0-42bb-83ef-67ca67c846e5 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:22.996340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1dabd-4ed0-42bb-83ef-67ca67c846e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:22.996614 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1dabd-4ed0-42bb-83ef-67ca67c846e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:22.997263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1dabd-4ed0-42bb-83ef-67ca67c846e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:23.001728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1dabd-4ed0-42bb-83ef-67ca67c846e5 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:23.030058 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 966/1952] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:23.034268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1dabd-4ed0-42bb-83ef-67ca67c846e5 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:23.074383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1dabd-4ed0-42bb-83ef-67ca67c846e5 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:23.091315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85647171-79eb-417f-a371-02b7497f352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:23.092048 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647171-79eb-417f-a371-02b7497f352f admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:23.092330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647171-79eb-417f-a371-02b7497f352f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:23.092608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647171-79eb-417f-a371-02b7497f352f admin admin] PATH_INFO: `/v3/projects/e1e42aa903244de492370cbb530aa376/users/cfbf14437975433d8db2f07c2babd696/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:23.132475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d281ec-9a62-44f4-aeff-b75c97d8b3ad None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:23.134923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85647171-79eb-417f-a371-02b7497f352f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e42aa903244de492370cbb530aa376, user_id=cfbf14437975433d8db2f07c2babd696, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:23.138494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85647171-79eb-417f-a371-02b7497f352f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:23.156687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47664153-bcbe-45b8-ac6b-d9e70540c7cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:23.158026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47664153-bcbe-45b8-ac6b-d9e70540c7cb service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:23.159700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47664153-bcbe-45b8-ac6b-d9e70540c7cb service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:23.160215 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47664153-bcbe-45b8-ac6b-d9e70540c7cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:23.165099 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 967/1953] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:23 2022] PUT /identity/v3/projects/e1e42aa903244de492370cbb530aa376/users/cfbf14437975433d8db2f07c2babd696/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:23.166256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85647171-79eb-417f-a371-02b7497f352f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:23.209055 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47664153-bcbe-45b8-ac6b-d9e70540c7cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:23.210615 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47664153-bcbe-45b8-ac6b-d9e70540c7cb service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:23.239378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 987/1954] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:51:23.438703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85647171-79eb-417f-a371-02b7497f352f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:23.466593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114794f1-ba0a-48f9-b6b8-0fda440529ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:23.467458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114794f1-ba0a-48f9-b6b8-0fda440529ad admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:23.468036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114794f1-ba0a-48f9-b6b8-0fda440529ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:23.468473 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114794f1-ba0a-48f9-b6b8-0fda440529ad admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:23.469272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114794f1-ba0a-48f9-b6b8-0fda440529ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:23.471085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114794f1-ba0a-48f9-b6b8-0fda440529ad admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:23.499829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 968/1955] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:23.501232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47664153-bcbe-45b8-ac6b-d9e70540c7cb service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:23.541628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47664153-bcbe-45b8-ac6b-d9e70540c7cb service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:23.554794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ace7b-82a4-4647-b2c6-b1a1eb015b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:23.555556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ace7b-82a4-4647-b2c6-b1a1eb015b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:23.556716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ace7b-82a4-4647-b2c6-b1a1eb015b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:23.557401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ace7b-82a4-4647-b2c6-b1a1eb015b51 admin admin] PATH_INFO: `/v3/projects/e1e42aa903244de492370cbb530aa376/users/cfbf14437975433d8db2f07c2babd696/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:23.563907 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ace7b-82a4-4647-b2c6-b1a1eb015b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e42aa903244de492370cbb530aa376, user_id=cfbf14437975433d8db2f07c2babd696, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:23.569706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ace7b-82a4-4647-b2c6-b1a1eb015b51 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:23.615480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 988/1956] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:23 2022] PUT /identity/v3/projects/e1e42aa903244de492370cbb530aa376/users/cfbf14437975433d8db2f07c2babd696/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:23.625451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f9e38-822a-48cd-8ae8-c1727725a87b None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:23.628397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f9e38-822a-48cd-8ae8-c1727725a87b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:23.628397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f9e38-822a-48cd-8ae8-c1727725a87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:23.670005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:23.713402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-fa1f9e38-822a-48cd-8ae8-c1727725a87b None None] MFA Rules not processed for user `cfbf14437975433d8db2f07c2babd696`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:23.714732 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fa1f9e38-822a-48cd-8ae8-c1727725a87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:23.897896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 969/1957] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:23.918462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ace7b-82a4-4647-b2c6-b1a1eb015b51 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:24.085831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ace7b-82a4-4647-b2c6-b1a1eb015b51 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:24.096376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b2ce5-3f94-482b-ba3e-77c52b544b70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:24.097180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b2ce5-3f94-482b-ba3e-77c52b544b70 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:24.097492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b2ce5-3f94-482b-ba3e-77c52b544b70 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:24.103542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b2ce5-3f94-482b-ba3e-77c52b544b70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:24.263899 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:24.269107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b2ce5-3f94-482b-ba3e-77c52b544b70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:24.270378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b2ce5-3f94-482b-ba3e-77c52b544b70 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:24.306318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 989/1958] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:24.375311 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f9e38-822a-48cd-8ae8-c1727725a87b None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:24.564953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f9e38-822a-48cd-8ae8-c1727725a87b None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:24.585219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:24.586053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:24.586346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:24.586631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] PATH_INFO: `/v3/users/416b8f53d7ea4dfa80c6692586eb709b` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:24.587866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416b8f53d7ea4dfa80c6692586eb709b)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:24.590817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:24.665188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416b8f53d7ea4dfa80c6692586eb709b'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:24.676298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416b8f53d7ea4dfa80c6692586eb709b'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:24.677405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416b8f53d7ea4dfa80c6692586eb709b'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:24.678755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416b8f53d7ea4dfa80c6692586eb709b'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:24.692664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416b8f53d7ea4dfa80c6692586eb709b'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:24.729599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 970/1959] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:24 2022] DELETE /identity/v3/users/416b8f53d7ea4dfa80c6692586eb709b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:24.733784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb1122-3e41-4f3d-9e05-073baf4fcc01 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:24.734170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb1122-3e41-4f3d-9e05-073baf4fcc01 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:24.734519 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb1122-3e41-4f3d-9e05-073baf4fcc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:24.763464 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-24bb1122-3e41-4f3d-9e05-073baf4fcc01 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:24.764648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-24bb1122-3e41-4f3d-9e05-073baf4fcc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:24.969006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 990/1960] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:24.997517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:25.014007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:25.059202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:25.212829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4232b-8f66-40e7-92e2-3fc50f6e5477 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:25.224929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402a5f1-bafa-4ec2-8d18-daa0b32de88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:25.225783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a5f1-bafa-4ec2-8d18-daa0b32de88b service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:25.226167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a5f1-bafa-4ec2-8d18-daa0b32de88b service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:25.226542 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a5f1-bafa-4ec2-8d18-daa0b32de88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:25.262561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402a5f1-bafa-4ec2-8d18-daa0b32de88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:25.265658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402a5f1-bafa-4ec2-8d18-daa0b32de88b service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:25.289333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 971/1961] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:25.726991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb1122-3e41-4f3d-9e05-073baf4fcc01 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:25.728581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-24bb1122-3e41-4f3d-9e05-073baf4fcc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:25.744648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb1122-3e41-4f3d-9e05-073baf4fcc01 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:25.761142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:25.762578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:25.764313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:25.765086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] PATH_INFO: `/v3/projects/d0cd3c5646ff44098df7239ebe7937db` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:25.767067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0cd3c5646ff44098df7239ebe7937db)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:25.769286 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:25.851024 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0cd3c5646ff44098df7239ebe7937db', 'request_id': 'req-ac648528-112e-4d41-afcc-e178aaa4756b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:25.852068 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0cd3c5646ff44098df7239ebe7937db', 'request_id': 'req-ac648528-112e-4d41-afcc-e178aaa4756b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:25.870676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0cd3c5646ff44098df7239ebe7937db', 'request_id': 'req-ac648528-112e-4d41-afcc-e178aaa4756b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:25.891172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] The token cache is being invalidate because project d0cd3c5646ff44098df7239ebe7937db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:25.892142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:25.892828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:25.898470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 991/1962] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:25 2022] DELETE /identity/v3/projects/d0cd3c5646ff44098df7239ebe7937db => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:25.903163 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402a5f1-bafa-4ec2-8d18-daa0b32de88b service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:25.923818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402a5f1-bafa-4ec2-8d18-daa0b32de88b service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:26.025938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:26.025938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:26.025938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:26.025938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] PATH_INFO: `/v3/users/97c74fba17e24561a719dc1849e89c02` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:26.029752 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c74fba17e24561a719dc1849e89c02)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:26.031813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:26.107160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c74fba17e24561a719dc1849e89c02'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:26.129795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c74fba17e24561a719dc1849e89c02'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:26.130704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c74fba17e24561a719dc1849e89c02'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:26.131656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c74fba17e24561a719dc1849e89c02'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:26.155145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c74fba17e24561a719dc1849e89c02'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:26.202631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 972/1963] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:25 2022] DELETE /identity/v3/users/97c74fba17e24561a719dc1849e89c02 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:26.483689 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:26.485174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:26.578131 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac648528-112e-4d41-afcc-e178aaa4756b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:26.651054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:26.654500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:26.656011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:26.730646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:26.748241 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93922060-6cd6-44fd-bc24-fb2eaeac0a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:26.748888 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93922060-6cd6-44fd-bc24-fb2eaeac0a44 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:26.749179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93922060-6cd6-44fd-bc24-fb2eaeac0a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:26.749461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93922060-6cd6-44fd-bc24-fb2eaeac0a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:26.757731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-93922060-6cd6-44fd-bc24-fb2eaeac0a44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:26.786429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb947afd-606c-47da-9121-0bd58f3f280e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:26.805066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:26.805754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:26.806040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:26.806450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] PATH_INFO: `/v3/projects/307caa9c5848478c91bedc0f7a91bbf6` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:26.808337 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=307caa9c5848478c91bedc0f7a91bbf6)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:26.811779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:26.842463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93922060-6cd6-44fd-bc24-fb2eaeac0a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:26.844001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93922060-6cd6-44fd-bc24-fb2eaeac0a44 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:26.859542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 992/1964] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:26.920672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307caa9c5848478c91bedc0f7a91bbf6', 'request_id': 'req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:26.942667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307caa9c5848478c91bedc0f7a91bbf6', 'request_id': 'req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:26.946973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307caa9c5848478c91bedc0f7a91bbf6', 'request_id': 'req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:26.959797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] The token cache is being invalidate because project 307caa9c5848478c91bedc0f7a91bbf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:26.960176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:26.960798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cb64ec2d-6ef2-4e3f-af57-ca5bd62cbe7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:26.962670 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 973/1965] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:26 2022] DELETE /identity/v3/projects/307caa9c5848478c91bedc0f7a91bbf6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:26.968735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eee52a-58bb-4f42-a088-c3b331fd2d75 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:26.969075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eee52a-58bb-4f42-a088-c3b331fd2d75 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:26.969357 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eee52a-58bb-4f42-a088-c3b331fd2d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:26.996858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-f3eee52a-58bb-4f42-a088-c3b331fd2d75 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:26.998913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f3eee52a-58bb-4f42-a088-c3b331fd2d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:27.078584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 993/1966] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:27.088675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d0af2-e9c8-47c3-b4a2-73fcb2ac30c3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:27.090323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d0af2-e9c8-47c3-b4a2-73fcb2ac30c3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:27.090812 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d0af2-e9c8-47c3-b4a2-73fcb2ac30c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:27.125224 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-9b2d0af2-e9c8-47c3-b4a2-73fcb2ac30c3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:27.126469 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9b2d0af2-e9c8-47c3-b4a2-73fcb2ac30c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:27.135412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 974/1967] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:51:27.140091 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eee52a-58bb-4f42-a088-c3b331fd2d75 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:27.160015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eee52a-58bb-4f42-a088-c3b331fd2d75 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:27.168416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47852041-b202-4e50-b9a5-c2b753ffb9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:27.168416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47852041-b202-4e50-b9a5-c2b753ffb9cc admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:27.168416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47852041-b202-4e50-b9a5-c2b753ffb9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:27.168416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47852041-b202-4e50-b9a5-c2b753ffb9cc admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:27.168840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47852041-b202-4e50-b9a5-c2b753ffb9cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:27.168840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47852041-b202-4e50-b9a5-c2b753ffb9cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:27.170429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47852041-b202-4e50-b9a5-c2b753ffb9cc admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:27.200093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 994/1968] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:51:27.204580 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d0af2-e9c8-47c3-b4a2-73fcb2ac30c3 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:27.218226 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d0af2-e9c8-47c3-b4a2-73fcb2ac30c3 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:27.242064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f832081-6418-4a93-9062-e5357ede392f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:27.242750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832081-6418-4a93-9062-e5357ede392f admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:27.243387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832081-6418-4a93-9062-e5357ede392f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:27.243829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832081-6418-4a93-9062-e5357ede392f admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:27.247609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f832081-6418-4a93-9062-e5357ede392f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:27.250840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f832081-6418-4a93-9062-e5357ede392f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:27.331010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 975/1969] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:27 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:27.333201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47852041-b202-4e50-b9a5-c2b753ffb9cc admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:27.348496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12d9d-649c-45d1-8c27-cf5d955734eb None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:27.348841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12d9d-649c-45d1-8c27-cf5d955734eb None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:27.349774 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12d9d-649c-45d1-8c27-cf5d955734eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:27.351452 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47852041-b202-4e50-b9a5-c2b753ffb9cc admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:27.388371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-3de12d9d-649c-45d1-8c27-cf5d955734eb None None] MFA Rules not processed for user `508bedd24344422ab2009a0e96273854`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:27.393081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-3de12d9d-649c-45d1-8c27-cf5d955734eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:27.547630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed428-e70d-47b9-96fd-4cc2c7ea3bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:27.550182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed428-e70d-47b9-96fd-4cc2c7ea3bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:27.554063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed428-e70d-47b9-96fd-4cc2c7ea3bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:27.558920 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed428-e70d-47b9-96fd-4cc2c7ea3bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:27.558920 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ed428-e70d-47b9-96fd-4cc2c7ea3bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:27.558920 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ed428-e70d-47b9-96fd-4cc2c7ea3bc1 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:27.612491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 976/1970] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:27.664717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 995/1971] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:27 2022] POST /identity/v3/users => generated 289 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:27.668938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12d9d-649c-45d1-8c27-cf5d955734eb None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:27.682780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12d9d-649c-45d1-8c27-cf5d955734eb None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:27.700445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fff809-d79a-48bc-923c-bbebb68c365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:27.701389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fff809-d79a-48bc-923c-bbebb68c365c admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:27.701773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fff809-d79a-48bc-923c-bbebb68c365c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:27.702007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fff809-d79a-48bc-923c-bbebb68c365c admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:27.702900 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fff809-d79a-48bc-923c-bbebb68c365c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:27.705429 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fff809-d79a-48bc-923c-bbebb68c365c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:27.742560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 977/1972] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:27.746868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed428-e70d-47b9-96fd-4cc2c7ea3bc1 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:27.763503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed428-e70d-47b9-96fd-4cc2c7ea3bc1 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:27.773284 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31affe40-4988-418a-90da-c07dfdbda82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:27.773918 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31affe40-4988-418a-90da-c07dfdbda82c admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:27.774217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31affe40-4988-418a-90da-c07dfdbda82c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:27.774468 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31affe40-4988-418a-90da-c07dfdbda82c admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:27.775136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31affe40-4988-418a-90da-c07dfdbda82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:27.776978 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fff809-d79a-48bc-923c-bbebb68c365c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:27.779266 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c4fff809-d79a-48bc-923c-bbebb68c365c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:27.792900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31affe40-4988-418a-90da-c07dfdbda82c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:27.795845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:27.818815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 996/1973] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:27.820752 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31affe40-4988-418a-90da-c07dfdbda82c admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:27.832550 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31affe40-4988-418a-90da-c07dfdbda82c admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:27.843070 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586278f8-6510-49eb-b7c3-478592cfd78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:27.843415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:27.852379 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586278f8-6510-49eb-b7c3-478592cfd78b admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:27.852666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586278f8-6510-49eb-b7c3-478592cfd78b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:27.852953 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586278f8-6510-49eb-b7c3-478592cfd78b admin admin] PATH_INFO: `/v3/projects/376fce8c692c4619acc78282d6744d84/users/07491388e91749e8b847ba2c12632d98/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:27.871749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586278f8-6510-49eb-b7c3-478592cfd78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=376fce8c692c4619acc78282d6744d84, user_id=07491388e91749e8b847ba2c12632d98, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:27.874504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586278f8-6510-49eb-b7c3-478592cfd78b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:27.878735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fff809-d79a-48bc-923c-bbebb68c365c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:27.885908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f3b7d-ec38-4592-bd80-d2ba51b9d783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:27.885908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3b7d-ec38-4592-bd80-d2ba51b9d783 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:27.885908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3b7d-ec38-4592-bd80-d2ba51b9d783 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:27.885908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3b7d-ec38-4592-bd80-d2ba51b9d783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:27.889109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f61f3b7d-ec38-4592-bd80-d2ba51b9d783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:27.901979 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 997/1974] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:27 2022] PUT /identity/v3/projects/376fce8c692c4619acc78282d6744d84/users/07491388e91749e8b847ba2c12632d98/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:27.901979 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc6b0d-698a-4716-a2bb-e665dcfcb05c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:27.901979 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc6b0d-698a-4716-a2bb-e665dcfcb05c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:27.901979 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc6b0d-698a-4716-a2bb-e665dcfcb05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:27.924926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-63bc6b0d-698a-4716-a2bb-e665dcfcb05c None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:27.926304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-63bc6b0d-698a-4716-a2bb-e665dcfcb05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:27.987141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f3b7d-ec38-4592-bd80-d2ba51b9d783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:27.988745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f3b7d-ec38-4592-bd80-d2ba51b9d783 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:28.003164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 978/1975] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:28.004650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170362dc-20ca-498b-af50-a226b7a8d257 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:28.004943 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170362dc-20ca-498b-af50-a226b7a8d257 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:28.005703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170362dc-20ca-498b-af50-a226b7a8d257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:28.008763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 998/1976] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:51:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:28.022483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc6b0d-698a-4716-a2bb-e665dcfcb05c None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:28.024694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-63bc6b0d-698a-4716-a2bb-e665dcfcb05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:28.075529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-170362dc-20ca-498b-af50-a226b7a8d257 None None] MFA Rules not processed for user `07491388e91749e8b847ba2c12632d98`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:28.077038 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-170362dc-20ca-498b-af50-a226b7a8d257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:28.184881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 979/1977] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:28.187880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170362dc-20ca-498b-af50-a226b7a8d257 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:28.195577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc6b0d-698a-4716-a2bb-e665dcfcb05c None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:28.205769 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e487b-01f3-4d96-b57b-88540146dc4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:28.207318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e487b-01f3-4d96-b57b-88540146dc4f service swift] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:28.207613 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e487b-01f3-4d96-b57b-88540146dc4f service swift] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:28.207893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e487b-01f3-4d96-b57b-88540146dc4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:28.220364 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e487b-01f3-4d96-b57b-88540146dc4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:28.222742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e487b-01f3-4d96-b57b-88540146dc4f service swift] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:28.246459 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 999/1978] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:51:28.313028 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170362dc-20ca-498b-af50-a226b7a8d257 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:28.320657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56a852-bb79-42d7-ba72-43bebbb796bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:28.321477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56a852-bb79-42d7-ba72-43bebbb796bc admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:28.321883 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56a852-bb79-42d7-ba72-43bebbb796bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:28.322238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56a852-bb79-42d7-ba72-43bebbb796bc admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:28.323348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56a852-bb79-42d7-ba72-43bebbb796bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:28.326758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56a852-bb79-42d7-ba72-43bebbb796bc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:28.350608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:28.377501 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 980/1979] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:28 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:28.382848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e487b-01f3-4d96-b57b-88540146dc4f service swift] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:28.396856 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e487b-01f3-4d96-b57b-88540146dc4f service swift] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:28.472504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bf441-ad9d-4767-9d07-14140396bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:28.472612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf441-ad9d-4767-9d07-14140396bec8 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:28.473319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf441-ad9d-4767-9d07-14140396bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:28.473319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf441-ad9d-4767-9d07-14140396bec8 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:28.473768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bf441-ad9d-4767-9d07-14140396bec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:28.476359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bf441-ad9d-4767-9d07-14140396bec8 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:28.492569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:28.511302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1000/1980] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:28 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:51:28.515767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56a852-bb79-42d7-ba72-43bebbb796bc admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:28.532149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56a852-bb79-42d7-ba72-43bebbb796bc admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:28.537595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbde1c0-735a-4484-b1f4-174d6b83a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:28.541446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbde1c0-735a-4484-b1f4-174d6b83a20f admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:28.541942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbde1c0-735a-4484-b1f4-174d6b83a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:28.542228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbde1c0-735a-4484-b1f4-174d6b83a20f admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:28.543235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbde1c0-735a-4484-b1f4-174d6b83a20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:28.545200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbde1c0-735a-4484-b1f4-174d6b83a20f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:28.562724 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 981/1981] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:28.563829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bf441-ad9d-4767-9d07-14140396bec8 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:28.582400 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bf441-ad9d-4767-9d07-14140396bec8 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:28.596127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade39fd-1df7-422e-8c32-04949bb487e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:28.599509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade39fd-1df7-422e-8c32-04949bb487e0 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:28.599509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade39fd-1df7-422e-8c32-04949bb487e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:28.599509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade39fd-1df7-422e-8c32-04949bb487e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:28.599509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade39fd-1df7-422e-8c32-04949bb487e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:28.602656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade39fd-1df7-422e-8c32-04949bb487e0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:28.629266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1001/1982] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:28.632326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbde1c0-735a-4484-b1f4-174d6b83a20f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:28.645124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbde1c0-735a-4484-b1f4-174d6b83a20f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:28.654748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af35d7-04c9-4721-85a6-3e3e50a8818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:28.654973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af35d7-04c9-4721-85a6-3e3e50a8818b admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:28.655250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af35d7-04c9-4721-85a6-3e3e50a8818b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:28.655584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af35d7-04c9-4721-85a6-3e3e50a8818b admin admin] PATH_INFO: `/v3/projects/678d2b3b5cf34b70b8a8b775a5df672c/users/a80e30279c874293baaeff97e81346c1/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:28.673345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af35d7-04c9-4721-85a6-3e3e50a8818b admin admin] RBAC: Authorizing `identity:create_grant(project_id=678d2b3b5cf34b70b8a8b775a5df672c, user_id=a80e30279c874293baaeff97e81346c1, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:28.676973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af35d7-04c9-4721-85a6-3e3e50a8818b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:28.703339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 982/1983] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:28 2022] PUT /identity/v3/projects/678d2b3b5cf34b70b8a8b775a5df672c/users/a80e30279c874293baaeff97e81346c1/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:28.712742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb39a-8d6d-4d4c-9636-e148a781cecc None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:28.716610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb39a-8d6d-4d4c-9636-e148a781cecc None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:28.718039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb39a-8d6d-4d4c-9636-e148a781cecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:28.771795 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-4ecfb39a-8d6d-4d4c-9636-e148a781cecc None None] MFA Rules not processed for user `a80e30279c874293baaeff97e81346c1`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:28.776971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4ecfb39a-8d6d-4d4c-9636-e148a781cecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:28.879638 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1002/1984] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:28.884907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af35d7-04c9-4721-85a6-3e3e50a8818b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:28.992246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af35d7-04c9-4721-85a6-3e3e50a8818b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:28.997137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee98ff-79be-4ea5-8565-ce51dec1e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:28.997864 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee98ff-79be-4ea5-8565-ce51dec1e268 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:28.998174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee98ff-79be-4ea5-8565-ce51dec1e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:28.998446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee98ff-79be-4ea5-8565-ce51dec1e268 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:28.999189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee98ff-79be-4ea5-8565-ce51dec1e268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:29.002026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee98ff-79be-4ea5-8565-ce51dec1e268 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:29.043175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 983/1985] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:28 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:51:29.044066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfb39a-8d6d-4d4c-9636-e148a781cecc None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:29.064509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfb39a-8d6d-4d4c-9636-e148a781cecc None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:29.195358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143beb4-7fd8-45d9-b0fe-e0548385a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:29.196309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143beb4-7fd8-45d9-b0fe-e0548385a34e admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:29.196781 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143beb4-7fd8-45d9-b0fe-e0548385a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:29.197215 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143beb4-7fd8-45d9-b0fe-e0548385a34e admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:29.198317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143beb4-7fd8-45d9-b0fe-e0548385a34e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:29.200729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143beb4-7fd8-45d9-b0fe-e0548385a34e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:29.240230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1003/1986] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:29 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:51:29.243863 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee98ff-79be-4ea5-8565-ce51dec1e268 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:29.280172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee98ff-79be-4ea5-8565-ce51dec1e268 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:29.297925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a59e8-1bac-43ba-a09d-6518f4e4a5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:29.298856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a59e8-1bac-43ba-a09d-6518f4e4a5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:29.299193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a59e8-1bac-43ba-a09d-6518f4e4a5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:29.299447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a59e8-1bac-43ba-a09d-6518f4e4a5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:29.300141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a59e8-1bac-43ba-a09d-6518f4e4a5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:29.301841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a59e8-1bac-43ba-a09d-6518f4e4a5b3 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:29.321452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 984/1987] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:29.327238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143beb4-7fd8-45d9-b0fe-e0548385a34e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:29.343515 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143beb4-7fd8-45d9-b0fe-e0548385a34e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:29.357325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b6dab-dff1-4f2a-83f9-1ff2b8cb7ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:29.359252 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b6dab-dff1-4f2a-83f9-1ff2b8cb7ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:29.359758 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b6dab-dff1-4f2a-83f9-1ff2b8cb7ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:29.360416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b6dab-dff1-4f2a-83f9-1ff2b8cb7ed7 admin admin] PATH_INFO: `/v3/projects/dc99ad433244400199d13c221e1cc986/users/f9b06cfb201a41cd81858b9a0253fa99/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:29.392594 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b6dab-dff1-4f2a-83f9-1ff2b8cb7ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc99ad433244400199d13c221e1cc986, user_id=f9b06cfb201a41cd81858b9a0253fa99, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:29.397558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b6dab-dff1-4f2a-83f9-1ff2b8cb7ed7 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:29.426825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1004/1988] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:29 2022] PUT /identity/v3/projects/dc99ad433244400199d13c221e1cc986/users/f9b06cfb201a41cd81858b9a0253fa99/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:29.429881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a59e8-1bac-43ba-a09d-6518f4e4a5b3 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:29.448206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a59e8-1bac-43ba-a09d-6518f4e4a5b3 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:29.619998 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de903f5b-e232-4b3f-b64c-303ffc04c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:29.621595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903f5b-e232-4b3f-b64c-303ffc04c555 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:29.622031 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903f5b-e232-4b3f-b64c-303ffc04c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:29.622466 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903f5b-e232-4b3f-b64c-303ffc04c555 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:29.623878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de903f5b-e232-4b3f-b64c-303ffc04c555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:29.627510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de903f5b-e232-4b3f-b64c-303ffc04c555 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:29.665163 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 985/1989] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:29.666317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b6dab-dff1-4f2a-83f9-1ff2b8cb7ed7 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:29.679440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b6dab-dff1-4f2a-83f9-1ff2b8cb7ed7 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:29.691662 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a2a30-e3a1-4df8-ba57-56694e36ae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:29.693127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a2a30-e3a1-4df8-ba57-56694e36ae88 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:29.693693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a2a30-e3a1-4df8-ba57-56694e36ae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:29.694289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a2a30-e3a1-4df8-ba57-56694e36ae88 admin admin] PATH_INFO: `/v3/projects/dc99ad433244400199d13c221e1cc986/users/f9b06cfb201a41cd81858b9a0253fa99/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:29.696689 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a2a30-e3a1-4df8-ba57-56694e36ae88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc99ad433244400199d13c221e1cc986, user_id=f9b06cfb201a41cd81858b9a0253fa99, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:29.700419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a2a30-e3a1-4df8-ba57-56694e36ae88 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:29.718003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1005/1990] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:29 2022] PUT /identity/v3/projects/dc99ad433244400199d13c221e1cc986/users/f9b06cfb201a41cd81858b9a0253fa99/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:29.733294 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac28a2-1861-4c83-ae44-2d306138312e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:29.733603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac28a2-1861-4c83-ae44-2d306138312e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:29.734006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac28a2-1861-4c83-ae44-2d306138312e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:29.803328 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6cac28a2-1861-4c83-ae44-2d306138312e None None] MFA Rules not processed for user `f9b06cfb201a41cd81858b9a0253fa99`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:29.811517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6cac28a2-1861-4c83-ae44-2d306138312e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:29.852948 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:29.948122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 986/1991] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:29.960162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a2a30-e3a1-4df8-ba57-56694e36ae88 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:30.013587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:30.066636 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a2a30-e3a1-4df8-ba57-56694e36ae88 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:30.074045 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611bb5f-ae9e-46df-a27b-0339ff841726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:30.074676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bb5f-ae9e-46df-a27b-0339ff841726 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:30.074958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bb5f-ae9e-46df-a27b-0339ff841726 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:30.075232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bb5f-ae9e-46df-a27b-0339ff841726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:30.101564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611bb5f-ae9e-46df-a27b-0339ff841726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:30.103453 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611bb5f-ae9e-46df-a27b-0339ff841726 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:30.120208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1006/1992] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:30.206932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac28a2-1861-4c83-ae44-2d306138312e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:30.223327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6cac28a2-1861-4c83-ae44-2d306138312e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:30.250730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac28a2-1861-4c83-ae44-2d306138312e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:30.258500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d2b49-cf75-4ec8-b0b9-c85a7b98b3ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:30.259459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d2b49-cf75-4ec8-b0b9-c85a7b98b3ff service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:30.260218 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d2b49-cf75-4ec8-b0b9-c85a7b98b3ff service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:30.261326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d2b49-cf75-4ec8-b0b9-c85a7b98b3ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:30.355402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d2b49-cf75-4ec8-b0b9-c85a7b98b3ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:30.357208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d2b49-cf75-4ec8-b0b9-c85a7b98b3ff service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:30.384255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 987/1993] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:32.549682 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611bb5f-ae9e-46df-a27b-0339ff841726 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:32.554228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-7611bb5f-ae9e-46df-a27b-0339ff841726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:32.650393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611bb5f-ae9e-46df-a27b-0339ff841726 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:32.659168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:32.660398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:32.660695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:32.660977 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] PATH_INFO: `/v3/users/5ea86f4e5dfa4c7c9127da0c4ff37f0e` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:32.662300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea86f4e5dfa4c7c9127da0c4ff37f0e)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:32.664667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:32.731023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea86f4e5dfa4c7c9127da0c4ff37f0e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:32.740292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea86f4e5dfa4c7c9127da0c4ff37f0e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:32.740932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea86f4e5dfa4c7c9127da0c4ff37f0e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:32.742055 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea86f4e5dfa4c7c9127da0c4ff37f0e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:32.757696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea86f4e5dfa4c7c9127da0c4ff37f0e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:32.783633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1007/1994] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:32 2022] DELETE /identity/v3/users/5ea86f4e5dfa4c7c9127da0c4ff37f0e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:32.785135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2a568-e102-47da-b3a8-834f219e1fca None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:32.785627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2a568-e102-47da-b3a8-834f219e1fca None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:32.785726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2a568-e102-47da-b3a8-834f219e1fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:32.817509 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-2af2a568-e102-47da-b3a8-834f219e1fca None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:32.818733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2af2a568-e102-47da-b3a8-834f219e1fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:32.918234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 988/1995] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:32.929876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:32.931344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:33.095584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:33.101776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eacd70-8789-4bfd-bc10-6ab443a09465 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:33.115526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736ae2d-8d8c-41c2-b17a-10819244e146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:33.116759 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736ae2d-8d8c-41c2-b17a-10819244e146 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:33.117031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736ae2d-8d8c-41c2-b17a-10819244e146 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:33.119669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736ae2d-8d8c-41c2-b17a-10819244e146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:33.138406 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736ae2d-8d8c-41c2-b17a-10819244e146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:33.149950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736ae2d-8d8c-41c2-b17a-10819244e146 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:33.188371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1008/1996] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:33.621779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2a568-e102-47da-b3a8-834f219e1fca None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:33.623324 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2af2a568-e102-47da-b3a8-834f219e1fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:33.645929 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2a568-e102-47da-b3a8-834f219e1fca None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:33.665480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:33.668025 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:33.669983 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:33.669983 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] PATH_INFO: `/v3/projects/436fde3212324a9d96d231a2cf0f02e0` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:33.672963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] RBAC: Authorizing `identity:delete_project(project_id=436fde3212324a9d96d231a2cf0f02e0)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:33.677861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:33.745729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736ae2d-8d8c-41c2-b17a-10819244e146 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:33.749175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-7736ae2d-8d8c-41c2-b17a-10819244e146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:33.773889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:33.779018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436fde3212324a9d96d231a2cf0f02e0', 'request_id': 'req-f0a89d51-cbda-4c46-ba1f-33f17565443e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:33.789784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736ae2d-8d8c-41c2-b17a-10819244e146 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:33.790355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436fde3212324a9d96d231a2cf0f02e0', 'request_id': 'req-f0a89d51-cbda-4c46-ba1f-33f17565443e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:33.802750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436fde3212324a9d96d231a2cf0f02e0', 'request_id': 'req-f0a89d51-cbda-4c46-ba1f-33f17565443e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:33.828277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] The token cache is being invalidate because project 436fde3212324a9d96d231a2cf0f02e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:33.828738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:33.829516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:33.836432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 989/1997] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:33 2022] DELETE /identity/v3/projects/436fde3212324a9d96d231a2cf0f02e0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:33.837754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:33.839302 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:33.882048 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:33.882713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:33.882992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:33.883268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] PATH_INFO: `/v3/users/07491388e91749e8b847ba2c12632d98` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:33.884481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07491388e91749e8b847ba2c12632d98)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:33.886433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:33.979840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07491388e91749e8b847ba2c12632d98'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:34.004751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89d51-cbda-4c46-ba1f-33f17565443e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:34.010777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:34.011637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:34.012076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:34.012530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] PATH_INFO: `/v3/users/9fe1245d00244578a70c298d3b98faec` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:34.014269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe1245d00244578a70c298d3b98faec)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:34.025387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07491388e91749e8b847ba2c12632d98'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:34.026142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07491388e91749e8b847ba2c12632d98'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:34.026868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07491388e91749e8b847ba2c12632d98'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:34.027307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:34.042196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3b6776c3-2052-44d3-b8ea-345ca70e5325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07491388e91749e8b847ba2c12632d98'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:34.095810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1009/1998] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:33 2022] DELETE /identity/v3/users/07491388e91749e8b847ba2c12632d98 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:34.100156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce1a55-3a93-44a9-887a-6f84f9b860d9 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:34.100570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce1a55-3a93-44a9-887a-6f84f9b860d9 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:34.101998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce1a55-3a93-44a9-887a-6f84f9b860d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:34.140970 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe1245d00244578a70c298d3b98faec'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:34.150220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-4cce1a55-3a93-44a9-887a-6f84f9b860d9 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:34.151529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4cce1a55-3a93-44a9-887a-6f84f9b860d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:34.156438 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe1245d00244578a70c298d3b98faec'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:34.157617 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe1245d00244578a70c298d3b98faec'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:34.158961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe1245d00244578a70c298d3b98faec'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:34.170849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe1245d00244578a70c298d3b98faec'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:34.215723 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 990/1999] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:33 2022] DELETE /identity/v3/users/9fe1245d00244578a70c298d3b98faec => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:34.283021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1010/2000] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:34.322344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:34.324945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:34.458704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6845-b7d4-4c33-a910-c3693c637d13 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:34.466905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b54e7-9dbe-4eb2-836f-ad34590ad9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:34.468284 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b54e7-9dbe-4eb2-836f-ad34590ad9db service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:34.468737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b54e7-9dbe-4eb2-836f-ad34590ad9db service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:34.469648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b54e7-9dbe-4eb2-836f-ad34590ad9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:34.485153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:34.636503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b54e7-9dbe-4eb2-836f-ad34590ad9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:34.638377 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b54e7-9dbe-4eb2-836f-ad34590ad9db service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:34.653902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 991/2001] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:34.843656 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce1a55-3a93-44a9-887a-6f84f9b860d9 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:34.845171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4cce1a55-3a93-44a9-887a-6f84f9b860d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:34.870722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce1a55-3a93-44a9-887a-6f84f9b860d9 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:34.879726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:34.880462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:34.880800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:34.881012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] PATH_INFO: `/v3/projects/f0155c600bcc4a848ed07539af82c6f4` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:34.886276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0155c600bcc4a848ed07539af82c6f4)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:34.887754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:34.923970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:35.066697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0155c600bcc4a848ed07539af82c6f4', 'request_id': 'req-714e3ec4-d971-4dd2-90ab-3cd3214bda82'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.092000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0155c600bcc4a848ed07539af82c6f4', 'request_id': 'req-714e3ec4-d971-4dd2-90ab-3cd3214bda82'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.112259 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0155c600bcc4a848ed07539af82c6f4', 'request_id': 'req-714e3ec4-d971-4dd2-90ab-3cd3214bda82'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.150741 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] The token cache is being invalidate because project f0155c600bcc4a848ed07539af82c6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:35.151232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.152142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.157199 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1011/2002] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:34 2022] DELETE /identity/v3/projects/f0155c600bcc4a848ed07539af82c6f4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:35.158193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b54e7-9dbe-4eb2-836f-ad34590ad9db service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:35.172074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b54e7-9dbe-4eb2-836f-ad34590ad9db service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:35.284670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:35.286704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:35.341417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:35.342030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:35.342431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:35.342740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] PATH_INFO: `/v3/users/cfbf14437975433d8db2f07c2babd696` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:35.344221 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbf14437975433d8db2f07c2babd696)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:35.347022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:35.438341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e3ec4-d971-4dd2-90ab-3cd3214bda82 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:35.451763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:35.452484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:35.452784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:35.453061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] PATH_INFO: `/v3/projects/376fce8c692c4619acc78282d6744d84` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:35.455149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=376fce8c692c4619acc78282d6744d84)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:35.457999 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:35.460123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbf14437975433d8db2f07c2babd696'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.475059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbf14437975433d8db2f07c2babd696'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.476097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbf14437975433d8db2f07c2babd696'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.476826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbf14437975433d8db2f07c2babd696'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.499757 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbf14437975433d8db2f07c2babd696'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.539454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 992/2003] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:35 2022] DELETE /identity/v3/users/cfbf14437975433d8db2f07c2babd696 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:35.615906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376fce8c692c4619acc78282d6744d84', 'request_id': 'req-5a55b217-3492-40bc-9306-dbd2572f4eb6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.631838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376fce8c692c4619acc78282d6744d84', 'request_id': 'req-5a55b217-3492-40bc-9306-dbd2572f4eb6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.642287 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376fce8c692c4619acc78282d6744d84', 'request_id': 'req-5a55b217-3492-40bc-9306-dbd2572f4eb6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.668091 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] The token cache is being invalidate because project 376fce8c692c4619acc78282d6744d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:35.668471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.671032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:35.674733 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1012/2004] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:35 2022] DELETE /identity/v3/projects/376fce8c692c4619acc78282d6744d84 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:35.679315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:35.680931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:35.755743 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:35.854419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857007b-95d8-4161-934e-0bb8ed2bca1d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:36.042059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:36.043184 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:36.043823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:36.044330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] PATH_INFO: `/v3/users/a80e30279c874293baaeff97e81346c1` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:36.045873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80e30279c874293baaeff97e81346c1)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:36.048234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:36.307654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80e30279c874293baaeff97e81346c1'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:36.322518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80e30279c874293baaeff97e81346c1'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:36.324519 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80e30279c874293baaeff97e81346c1'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:36.327621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80e30279c874293baaeff97e81346c1'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:36.341354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80e30279c874293baaeff97e81346c1'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:36.386102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 993/2005] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:35 2022] DELETE /identity/v3/users/a80e30279c874293baaeff97e81346c1 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:36.853486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:36.855668 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:36.877186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55b217-3492-40bc-9306-dbd2572f4eb6 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:36.922377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:36.992136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:36.992809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:36.993090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:36.993558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] PATH_INFO: `/v3/projects/678d2b3b5cf34b70b8a8b775a5df672c` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:36.995132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=678d2b3b5cf34b70b8a8b775a5df672c)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:36.997139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:37.098836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '678d2b3b5cf34b70b8a8b775a5df672c', 'request_id': 'req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.118417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '678d2b3b5cf34b70b8a8b775a5df672c', 'request_id': 'req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.136508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '678d2b3b5cf34b70b8a8b775a5df672c', 'request_id': 'req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.154554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] The token cache is being invalidate because project 678d2b3b5cf34b70b8a8b775a5df672c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:37.155753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.156647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.161657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1013/2006] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:36 2022] DELETE /identity/v3/projects/678d2b3b5cf34b70b8a8b775a5df672c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:37.163005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:37.164631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:37.181814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a6c65-6b21-49b8-9272-850773806b9d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:37.227244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:37.230247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:37.244735 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:37.259936 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:37.261139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:37.261666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:37.262265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] PATH_INFO: `/v3/users/f9b06cfb201a41cd81858b9a0253fa99` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:37.264411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b06cfb201a41cd81858b9a0253fa99)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:37.267029 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:37.369284 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b06cfb201a41cd81858b9a0253fa99'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.385033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b06cfb201a41cd81858b9a0253fa99'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.386351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b06cfb201a41cd81858b9a0253fa99'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.387618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b06cfb201a41cd81858b9a0253fa99'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.397031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d60da-0e5f-4889-9e0b-d8559f52de0f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:37.400427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-36f28cf1-fda7-4bf1-95b4-50ad8a6dae88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b06cfb201a41cd81858b9a0253fa99'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.406597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:37.407428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:37.407790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:37.408219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] PATH_INFO: `/v3/projects/e1e42aa903244de492370cbb530aa376` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:37.409504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e42aa903244de492370cbb530aa376)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:37.412674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:37.436835 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 994/2007] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:37 2022] DELETE /identity/v3/users/f9b06cfb201a41cd81858b9a0253fa99 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:37.521313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e42aa903244de492370cbb530aa376', 'request_id': 'req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.559140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e42aa903244de492370cbb530aa376', 'request_id': 'req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.561292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:37.573453 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e42aa903244de492370cbb530aa376', 'request_id': 'req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.600416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] The token cache is being invalidate because project e1e42aa903244de492370cbb530aa376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:37.600896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.601809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d7d71cd0-4f1e-4020-b80f-4ec008e874ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:37.604206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1014/2008] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:37 2022] DELETE /identity/v3/projects/e1e42aa903244de492370cbb530aa376 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:37.610314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623fc56-0c84-4a55-a1fb-afe6a1ff45b5 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:37.610819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623fc56-0c84-4a55-a1fb-afe6a1ff45b5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:37.611137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623fc56-0c84-4a55-a1fb-afe6a1ff45b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:37.655867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-d623fc56-0c84-4a55-a1fb-afe6a1ff45b5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:37.657356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d623fc56-0c84-4a55-a1fb-afe6a1ff45b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:37.778023 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 995/2009] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:37.786039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d22e0-7b2a-43fe-96a7-6c4bb11bc71e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:37.786511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d22e0-7b2a-43fe-96a7-6c4bb11bc71e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:37.786952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d22e0-7b2a-43fe-96a7-6c4bb11bc71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:37.823798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-5e6d22e0-7b2a-43fe-96a7-6c4bb11bc71e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:37.826852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5e6d22e0-7b2a-43fe-96a7-6c4bb11bc71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:37.860139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623fc56-0c84-4a55-a1fb-afe6a1ff45b5 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:37.872971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1015/2010] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:37.877861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623fc56-0c84-4a55-a1fb-afe6a1ff45b5 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:37.891778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e281b30-7e90-4bf2-8fb9-8085272d596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:37.893198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281b30-7e90-4bf2-8fb9-8085272d596d admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:37.893923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281b30-7e90-4bf2-8fb9-8085272d596d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:37.896228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281b30-7e90-4bf2-8fb9-8085272d596d admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:37.898191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e281b30-7e90-4bf2-8fb9-8085272d596d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:37.900781 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e281b30-7e90-4bf2-8fb9-8085272d596d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:37.902660 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e281b30-7e90-4bf2-8fb9-8085272d596d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:37.933288 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 996/2011] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:51:37.937313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d22e0-7b2a-43fe-96a7-6c4bb11bc71e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:37.945911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e281b30-7e90-4bf2-8fb9-8085272d596d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:37.948164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5e281b30-7e90-4bf2-8fb9-8085272d596d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:37.963457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e281b30-7e90-4bf2-8fb9-8085272d596d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:37.967904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d22e0-7b2a-43fe-96a7-6c4bb11bc71e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:37.969006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:37.969749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:37.970113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:37.970468 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] PATH_INFO: `/v3/projects/dc99ad433244400199d13c221e1cc986` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:37.971820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc99ad433244400199d13c221e1cc986)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:37.974490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:37.992351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae279541-cdcc-4f8a-8de3-d3e290880c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:37.995820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae279541-cdcc-4f8a-8de3-d3e290880c01 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:37.996103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae279541-cdcc-4f8a-8de3-d3e290880c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:37.998291 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae279541-cdcc-4f8a-8de3-d3e290880c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.000608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae279541-cdcc-4f8a-8de3-d3e290880c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.008232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae279541-cdcc-4f8a-8de3-d3e290880c01 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.059301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc99ad433244400199d13c221e1cc986', 'request_id': 'req-4b7a30d4-fd0f-438e-898e-06ae86737132'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:38.062121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:38.069731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc99ad433244400199d13c221e1cc986', 'request_id': 'req-4b7a30d4-fd0f-438e-898e-06ae86737132'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:38.084053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc99ad433244400199d13c221e1cc986', 'request_id': 'req-4b7a30d4-fd0f-438e-898e-06ae86737132'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:38.087441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1016/2012] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:37 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:38.089063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae279541-cdcc-4f8a-8de3-d3e290880c01 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.110924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] The token cache is being invalidate because project dc99ad433244400199d13c221e1cc986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:38.111386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:38.113933 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4b7a30d4-fd0f-438e-898e-06ae86737132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:38.123204 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 997/2013] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:37 2022] DELETE /identity/v3/projects/dc99ad433244400199d13c221e1cc986 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:38.125249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387277-8918-408a-84c3-a085f4fc7dec None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.125635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387277-8918-408a-84c3-a085f4fc7dec None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.126306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387277-8918-408a-84c3-a085f4fc7dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.193682 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c8387277-8918-408a-84c3-a085f4fc7dec None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:38.195540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c8387277-8918-408a-84c3-a085f4fc7dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:38.213200 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae279541-cdcc-4f8a-8de3-d3e290880c01 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.219031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2d7d4-1c65-4023-84ee-27d525d60e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.223076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d7d4-1c65-4023-84ee-27d525d60e07 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.223076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d7d4-1c65-4023-84ee-27d525d60e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.223076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d7d4-1c65-4023-84ee-27d525d60e07 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.223076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2d7d4-1c65-4023-84ee-27d525d60e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.224294 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2d7d4-1c65-4023-84ee-27d525d60e07 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.257832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1017/2014] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:38 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:38.259163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2d7d4-1c65-4023-84ee-27d525d60e07 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.263117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cdb2d7d4-1c65-4023-84ee-27d525d60e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:38.294394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2d7d4-1c65-4023-84ee-27d525d60e07 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.295918 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 998/2015] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:38.300130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ea351-bf12-4f59-b655-d8b77049e42e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.300630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ea351-bf12-4f59-b655-d8b77049e42e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.301041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ea351-bf12-4f59-b655-d8b77049e42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.309225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a9a7a-a54f-4a9e-869f-beba6ebbed76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.309871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9a7a-a54f-4a9e-869f-beba6ebbed76 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.310158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9a7a-a54f-4a9e-869f-beba6ebbed76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.310437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9a7a-a54f-4a9e-869f-beba6ebbed76 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.311089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a9a7a-a54f-4a9e-869f-beba6ebbed76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.315494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a9a7a-a54f-4a9e-869f-beba6ebbed76 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.326766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-731ea351-bf12-4f59-b655-d8b77049e42e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:38.328095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-731ea351-bf12-4f59-b655-d8b77049e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:38.330761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1018/2016] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:38.334554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a9a7a-a54f-4a9e-869f-beba6ebbed76 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.341475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 999/2017] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:38.344212 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ea351-bf12-4f59-b655-d8b77049e42e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.346077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a9a7a-a54f-4a9e-869f-beba6ebbed76 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.352315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416656c-c264-4da6-8c7b-63fe46ddacab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.353025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416656c-c264-4da6-8c7b-63fe46ddacab admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.353504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416656c-c264-4da6-8c7b-63fe46ddacab admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.353784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416656c-c264-4da6-8c7b-63fe46ddacab admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.354626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416656c-c264-4da6-8c7b-63fe46ddacab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.356604 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416656c-c264-4da6-8c7b-63fe46ddacab admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.362442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ea351-bf12-4f59-b655-d8b77049e42e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.370581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25891a6-cd33-4446-8c3f-b2a9b96474be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.371946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25891a6-cd33-4446-8c3f-b2a9b96474be admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.372154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1019/2018] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:38.372692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25891a6-cd33-4446-8c3f-b2a9b96474be admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.372976 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25891a6-cd33-4446-8c3f-b2a9b96474be admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.373636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25891a6-cd33-4446-8c3f-b2a9b96474be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:38.373947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25891a6-cd33-4446-8c3f-b2a9b96474be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.375801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25891a6-cd33-4446-8c3f-b2a9b96474be admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.378413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416656c-c264-4da6-8c7b-63fe46ddacab admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.388456 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1000/2019] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:51:38.392966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25891a6-cd33-4446-8c3f-b2a9b96474be admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.403109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416656c-c264-4da6-8c7b-63fe46ddacab admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.407513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25891a6-cd33-4446-8c3f-b2a9b96474be admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.408948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71539776-d113-4699-864a-335771044239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.409844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71539776-d113-4699-864a-335771044239 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.410350 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71539776-d113-4699-864a-335771044239 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.410798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71539776-d113-4699-864a-335771044239 admin admin] PATH_INFO: `/v3/projects/1a061c6fbac44a03b6e58b138ba95ba0/users/aa37eb12e65a4678a7153d1fdc37bdc5/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.413370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d964a28-f042-478c-87d6-36cda228cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.414349 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d964a28-f042-478c-87d6-36cda228cc5d admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.415518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d964a28-f042-478c-87d6-36cda228cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.419807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d964a28-f042-478c-87d6-36cda228cc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.420768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d964a28-f042-478c-87d6-36cda228cc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.423109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d964a28-f042-478c-87d6-36cda228cc5d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.433192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71539776-d113-4699-864a-335771044239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a061c6fbac44a03b6e58b138ba95ba0, user_id=aa37eb12e65a4678a7153d1fdc37bdc5, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.436064 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71539776-d113-4699-864a-335771044239 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.455205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1020/2020] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:38 2022] PUT /identity/v3/projects/1a061c6fbac44a03b6e58b138ba95ba0/users/aa37eb12e65a4678a7153d1fdc37bdc5/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:38.461155 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f060a-e954-4164-ab55-a95d4801f6ba None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.461438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f060a-e954-4164-ab55-a95d4801f6ba None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.461749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f060a-e954-4164-ab55-a95d4801f6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.481544 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1001/2021] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:38 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:51:38.482470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d964a28-f042-478c-87d6-36cda228cc5d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.501275 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-de6f060a-e954-4164-ab55-a95d4801f6ba None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:38.502594 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-de6f060a-e954-4164-ab55-a95d4801f6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:38.602779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:38.617742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1021/2022] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:51:38.628528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f060a-e954-4164-ab55-a95d4801f6ba None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.634967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-de6f060a-e954-4164-ab55-a95d4801f6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:38.642789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d964a28-f042-478c-87d6-36cda228cc5d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.655738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff4f49-ef77-42e6-a144-ee4c5d2f3c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.657915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff4f49-ef77-42e6-a144-ee4c5d2f3c94 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.660019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff4f49-ef77-42e6-a144-ee4c5d2f3c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.662895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff4f49-ef77-42e6-a144-ee4c5d2f3c94 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.663803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff4f49-ef77-42e6-a144-ee4c5d2f3c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.669238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff4f49-ef77-42e6-a144-ee4c5d2f3c94 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.722487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1002/2023] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:38 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:51:38.726402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff4f49-ef77-42e6-a144-ee4c5d2f3c94 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.743318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff4f49-ef77-42e6-a144-ee4c5d2f3c94 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.754401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21d2a1-0fa7-4256-b330-3b0d9785ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.756604 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21d2a1-0fa7-4256-b330-3b0d9785ffda admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.757852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f060a-e954-4164-ab55-a95d4801f6ba None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.758238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21d2a1-0fa7-4256-b330-3b0d9785ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.758589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21d2a1-0fa7-4256-b330-3b0d9785ffda admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.759939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21d2a1-0fa7-4256-b330-3b0d9785ffda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.763184 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21d2a1-0fa7-4256-b330-3b0d9785ffda admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.767941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1613d9-6605-458e-99f2-2bcda2f5407e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.768648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1613d9-6605-458e-99f2-2bcda2f5407e service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.769005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1613d9-6605-458e-99f2-2bcda2f5407e service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.769352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1613d9-6605-458e-99f2-2bcda2f5407e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.788255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1003/2024] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:38.791626 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21d2a1-0fa7-4256-b330-3b0d9785ffda admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.796563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1613d9-6605-458e-99f2-2bcda2f5407e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.798307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1613d9-6605-458e-99f2-2bcda2f5407e service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.809867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21d2a1-0fa7-4256-b330-3b0d9785ffda admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.833774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1022/2025] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:51:38.842671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33220ab2-e1f6-42dc-ada1-4654cc7fc1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.843319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33220ab2-e1f6-42dc-ada1-4654cc7fc1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.843610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33220ab2-e1f6-42dc-ada1-4654cc7fc1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.843885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33220ab2-e1f6-42dc-ada1-4654cc7fc1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.844525 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33220ab2-e1f6-42dc-ada1-4654cc7fc1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.846134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33220ab2-e1f6-42dc-ada1-4654cc7fc1d6 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.870982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1004/2026] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:38.875845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1613d9-6605-458e-99f2-2bcda2f5407e service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:38.892737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1613d9-6605-458e-99f2-2bcda2f5407e service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:38.918792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b83178-c722-4fe9-ad6f-d1d008532e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:38.918792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83178-c722-4fe9-ad6f-d1d008532e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.918792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83178-c722-4fe9-ad6f-d1d008532e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.918792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83178-c722-4fe9-ad6f-d1d008532e8b admin admin] PATH_INFO: `/v3/projects/5e69d14f70214d82afb96820531bb4b4/users/765e35da515c4e03a3fa2d95e5270b36/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:38.943937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b83178-c722-4fe9-ad6f-d1d008532e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e69d14f70214d82afb96820531bb4b4, user_id=765e35da515c4e03a3fa2d95e5270b36, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:38.946987 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b83178-c722-4fe9-ad6f-d1d008532e8b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:38.983432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1023/2027] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:38 2022] PUT /identity/v3/projects/5e69d14f70214d82afb96820531bb4b4/users/765e35da515c4e03a3fa2d95e5270b36/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:38.986982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e538bbf-d0ad-4899-ae08-575d8483e108 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:38.987272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e538bbf-d0ad-4899-ae08-575d8483e108 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:38.987653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e538bbf-d0ad-4899-ae08-575d8483e108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:39.030719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:39.067945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-1e538bbf-d0ad-4899-ae08-575d8483e108 None None] MFA Rules not processed for user `765e35da515c4e03a3fa2d95e5270b36`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:39.069021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1e538bbf-d0ad-4899-ae08-575d8483e108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:39.148124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1005/2028] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:39.161262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b83178-c722-4fe9-ad6f-d1d008532e8b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:39.163054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-75b83178-c722-4fe9-ad6f-d1d008532e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:39.253996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b83178-c722-4fe9-ad6f-d1d008532e8b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:39.256779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7454336-892c-4f12-9fe9-deb9066f630f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:39.257569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7454336-892c-4f12-9fe9-deb9066f630f service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:39.257957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7454336-892c-4f12-9fe9-deb9066f630f service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:39.258333 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7454336-892c-4f12-9fe9-deb9066f630f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:39.269161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7454336-892c-4f12-9fe9-deb9066f630f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:39.271450 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7454336-892c-4f12-9fe9-deb9066f630f service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:39.287028 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1024/2029] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:40.175489 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030c10-7d86-4a50-a238-3ae381e20e52 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:40.176031 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030c10-7d86-4a50-a238-3ae381e20e52 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:40.176031 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030c10-7d86-4a50-a238-3ae381e20e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:40.252324 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-06030c10-7d86-4a50-a238-3ae381e20e52 None None] MFA Rules not processed for user `aa37eb12e65a4678a7153d1fdc37bdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:40.254200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-06030c10-7d86-4a50-a238-3ae381e20e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:40.309811 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4c467-8120-4c68-ae78-654db3af910c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:40.309811 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4c467-8120-4c68-ae78-654db3af910c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:40.309811 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4c467-8120-4c68-ae78-654db3af910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:40.372265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-1dd4c467-8120-4c68-ae78-654db3af910c None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:40.373487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1dd4c467-8120-4c68-ae78-654db3af910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:40.463801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1006/2030] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:51:40.480904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06030c10-7d86-4a50-a238-3ae381e20e52 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:40.510679 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06030c10-7d86-4a50-a238-3ae381e20e52 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:40.529084 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d8aa-d8a9-4a93-bb0f-5996cde504c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:40.530937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d8aa-d8a9-4a93-bb0f-5996cde504c5 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:40.531225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d8aa-d8a9-4a93-bb0f-5996cde504c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:40.531523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d8aa-d8a9-4a93-bb0f-5996cde504c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:40.570253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d8aa-d8a9-4a93-bb0f-5996cde504c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:40.572516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d8aa-d8a9-4a93-bb0f-5996cde504c5 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:40.591492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1025/2031] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:51:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:40.623986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1007/2032] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:40.630170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4c467-8120-4c68-ae78-654db3af910c None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:40.631858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1dd4c467-8120-4c68-ae78-654db3af910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:40.669532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:40.764873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4c467-8120-4c68-ae78-654db3af910c None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:40.802671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c464cc-e704-4838-ad04-5e184208d8cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:40.803408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c464cc-e704-4838-ad04-5e184208d8cc service swift] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:40.803637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c464cc-e704-4838-ad04-5e184208d8cc service swift] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:40.803919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c464cc-e704-4838-ad04-5e184208d8cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:40.840359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c464cc-e704-4838-ad04-5e184208d8cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:40.842070 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c464cc-e704-4838-ad04-5e184208d8cc service swift] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:40.872686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1026/2033] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:51:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:51:42.646453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048628-bf2e-4118-9d7a-4292e498b95d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:42.647144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048628-bf2e-4118-9d7a-4292e498b95d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:42.647459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81048628-bf2e-4118-9d7a-4292e498b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:42.731750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-81048628-bf2e-4118-9d7a-4292e498b95d None None] MFA Rules not processed for user `aa37eb12e65a4678a7153d1fdc37bdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:42.743347 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-81048628-bf2e-4118-9d7a-4292e498b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:42.768264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1008/2034] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:50.866414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=20 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:51.678819 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c464cc-e704-4838-ad04-5e184208d8cc service swift] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:51.680549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b8c464cc-e704-4838-ad04-5e184208d8cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:51.746895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c464cc-e704-4838-ad04-5e184208d8cc service swift] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:51.751715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:51.752356 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:51.752632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:51.752907 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] PATH_INFO: `/v3/users/3fb107d2c1414da5a967ec95ffedb747` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:51.754087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb107d2c1414da5a967ec95ffedb747)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:51.756084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:51.803128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb107d2c1414da5a967ec95ffedb747'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:51.810385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb107d2c1414da5a967ec95ffedb747'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:51.811079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb107d2c1414da5a967ec95ffedb747'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:51.811722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb107d2c1414da5a967ec95ffedb747'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:51.820271 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb107d2c1414da5a967ec95ffedb747'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:51.839414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1027/2035] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:51 2022] DELETE /identity/v3/users/3fb107d2c1414da5a967ec95ffedb747 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:51.844078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8fa8c-1b71-4698-973c-c16a772fbe84 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:51.844905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8fa8c-1b71-4698-973c-c16a772fbe84 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:51.844905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8fa8c-1b71-4698-973c-c16a772fbe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:51.867053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-beb8fa8c-1b71-4698-973c-c16a772fbe84 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:51.870003 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-beb8fa8c-1b71-4698-973c-c16a772fbe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:51.945780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1009/2036] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:51:51.956561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:51.958072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:52.029158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5ced5-514e-4c27-990e-570f856c3e4d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:52.033427 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9f5ad-04ca-407a-bcb3-42ffa1d91d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:52.034436 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9f5ad-04ca-407a-bcb3-42ffa1d91d97 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:52.034840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9f5ad-04ca-407a-bcb3-42ffa1d91d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:52.035113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9f5ad-04ca-407a-bcb3-42ffa1d91d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:52.046991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9f5ad-04ca-407a-bcb3-42ffa1d91d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:52.048475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9f5ad-04ca-407a-bcb3-42ffa1d91d97 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:52.067664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1028/2037] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:52.370069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8fa8c-1b71-4698-973c-c16a772fbe84 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:52.371710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-beb8fa8c-1b71-4698-973c-c16a772fbe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:52.384071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8fa8c-1b71-4698-973c-c16a772fbe84 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:52.390198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:52.390459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:52.390785 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:52.391120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] PATH_INFO: `/v3/projects/ac21b9ff3bd346eab235ebb4bbbb5b44` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:52.392346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac21b9ff3bd346eab235ebb4bbbb5b44)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:52.394445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:52.396535 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:52.451131 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac21b9ff3bd346eab235ebb4bbbb5b44', 'request_id': 'req-b0cea469-ca22-4924-aa39-bbd4af839ca8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:52.464695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac21b9ff3bd346eab235ebb4bbbb5b44', 'request_id': 'req-b0cea469-ca22-4924-aa39-bbd4af839ca8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:52.474629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac21b9ff3bd346eab235ebb4bbbb5b44', 'request_id': 'req-b0cea469-ca22-4924-aa39-bbd4af839ca8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:52.509533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] The token cache is being invalidate because project ac21b9ff3bd346eab235ebb4bbbb5b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:52.510097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:52.512481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-b0cea469-ca22-4924-aa39-bbd4af839ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:52.514015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1010/2038] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:52 2022] DELETE /identity/v3/projects/ac21b9ff3bd346eab235ebb4bbbb5b44 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:52.519247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cabb8-b502-486f-9f0f-2b745b1b58e6 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:52.519549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cabb8-b502-486f-9f0f-2b745b1b58e6 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:52.520409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cabb8-b502-486f-9f0f-2b745b1b58e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:52.546702 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-178cabb8-b502-486f-9f0f-2b745b1b58e6 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:52.548508 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-178cabb8-b502-486f-9f0f-2b745b1b58e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:52.580767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:52.632371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1029/2039] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:52.640341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3facaa-cc74-43c4-84e8-1f61e51b01f4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:52.640632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3facaa-cc74-43c4-84e8-1f61e51b01f4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:52.640978 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3facaa-cc74-43c4-84e8-1f61e51b01f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:52.665580 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-fa3facaa-cc74-43c4-84e8-1f61e51b01f4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:52.666845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fa3facaa-cc74-43c4-84e8-1f61e51b01f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:52.677233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1011/2040] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:52.681023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cabb8-b502-486f-9f0f-2b745b1b58e6 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:52.693122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cabb8-b502-486f-9f0f-2b745b1b58e6 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:52.698628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacf0b0-99d6-448b-805b-69fca222dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:52.698886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacf0b0-99d6-448b-805b-69fca222dad3 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:52.699063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacf0b0-99d6-448b-805b-69fca222dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:52.699524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacf0b0-99d6-448b-805b-69fca222dad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:52.700395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacf0b0-99d6-448b-805b-69fca222dad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:52.700823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacf0b0-99d6-448b-805b-69fca222dad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:52.702959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacf0b0-99d6-448b-805b-69fca222dad3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:52.717156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1030/2041] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:51:52.721972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3facaa-cc74-43c4-84e8-1f61e51b01f4 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:52.734180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3facaa-cc74-43c4-84e8-1f61e51b01f4 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:52.739493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1270c-61f4-4956-adcb-78858a5ab109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:52.740111 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1270c-61f4-4956-adcb-78858a5ab109 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:52.740393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1270c-61f4-4956-adcb-78858a5ab109 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:52.740668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1270c-61f4-4956-adcb-78858a5ab109 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:52.742109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1270c-61f4-4956-adcb-78858a5ab109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:52.744047 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1270c-61f4-4956-adcb-78858a5ab109 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:52.781261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1012/2042] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:52 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:52.787206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacf0b0-99d6-448b-805b-69fca222dad3 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:52.798878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacf0b0-99d6-448b-805b-69fca222dad3 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:52.870835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe3444-b9ba-4f8c-b944-3b96c0a64678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:52.871536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe3444-b9ba-4f8c-b944-3b96c0a64678 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:52.871947 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe3444-b9ba-4f8c-b944-3b96c0a64678 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:52.872175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe3444-b9ba-4f8c-b944-3b96c0a64678 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:52.872809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe3444-b9ba-4f8c-b944-3b96c0a64678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:52.874772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe3444-b9ba-4f8c-b944-3b96c0a64678 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:52.900134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1031/2043] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:52 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:51:52.904219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1270c-61f4-4956-adcb-78858a5ab109 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:52.916160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1270c-61f4-4956-adcb-78858a5ab109 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:52.921473 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08260849-dd85-4dad-b33d-834bd7e09cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:52.922219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260849-dd85-4dad-b33d-834bd7e09cfc admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:52.922790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260849-dd85-4dad-b33d-834bd7e09cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:52.923165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260849-dd85-4dad-b33d-834bd7e09cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:52.923941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08260849-dd85-4dad-b33d-834bd7e09cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:52.925868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08260849-dd85-4dad-b33d-834bd7e09cfc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:52.961329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe3444-b9ba-4f8c-b944-3b96c0a64678 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:52.962482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1013/2044] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:51:52.983102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe3444-b9ba-4f8c-b944-3b96c0a64678 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:52.989117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cc76f-0397-4ad7-83bb-822b7842c819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:52.990103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc76f-0397-4ad7-83bb-822b7842c819 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:52.990485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc76f-0397-4ad7-83bb-822b7842c819 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:52.991062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc76f-0397-4ad7-83bb-822b7842c819 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:52.991917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cc76f-0397-4ad7-83bb-822b7842c819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:52.993571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cc76f-0397-4ad7-83bb-822b7842c819 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:53.004575 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1032/2045] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:53.008679 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08260849-dd85-4dad-b33d-834bd7e09cfc admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:53.018483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08260849-dd85-4dad-b33d-834bd7e09cfc admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:53.023755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e6a24-15f6-4673-908c-573b85b5561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:53.024478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e6a24-15f6-4673-908c-573b85b5561e admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:53.024826 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e6a24-15f6-4673-908c-573b85b5561e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:53.025165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e6a24-15f6-4673-908c-573b85b5561e admin admin] PATH_INFO: `/v3/projects/56521d5f697b43978a75bff9205fa1cd/users/47537307d40d49cfbc032c32bd9f9dbc/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:53.041847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e6a24-15f6-4673-908c-573b85b5561e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56521d5f697b43978a75bff9205fa1cd, user_id=47537307d40d49cfbc032c32bd9f9dbc, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:53.044647 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e6a24-15f6-4673-908c-573b85b5561e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:53.058077 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1014/2046] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:53 2022] PUT /identity/v3/projects/56521d5f697b43978a75bff9205fa1cd/users/47537307d40d49cfbc032c32bd9f9dbc/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:53.068968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01876dc-6609-4901-83c0-cac0e6abeceb None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:53.069259 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01876dc-6609-4901-83c0-cac0e6abeceb None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:53.069536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01876dc-6609-4901-83c0-cac0e6abeceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:53.105654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b01876dc-6609-4901-83c0-cac0e6abeceb None None] MFA Rules not processed for user `47537307d40d49cfbc032c32bd9f9dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:53.106957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b01876dc-6609-4901-83c0-cac0e6abeceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:53.188968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1033/2047] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:53.200491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e6a24-15f6-4673-908c-573b85b5561e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:53.202211 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-045e6a24-15f6-4673-908c-573b85b5561e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:53.286300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e6a24-15f6-4673-908c-573b85b5561e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:53.290316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd37766-2023-4758-bd35-a4775bfc32d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:53.291022 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd37766-2023-4758-bd35-a4775bfc32d4 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:53.292138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd37766-2023-4758-bd35-a4775bfc32d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:53.292138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd37766-2023-4758-bd35-a4775bfc32d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:53.319306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd37766-2023-4758-bd35-a4775bfc32d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:53.321065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd37766-2023-4758-bd35-a4775bfc32d4 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:53.349848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1015/2048] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:53.386989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01876dc-6609-4901-83c0-cac0e6abeceb None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:53.388553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b01876dc-6609-4901-83c0-cac0e6abeceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:53.417021 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:53.498416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01876dc-6609-4901-83c0-cac0e6abeceb None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:53.505153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:53.506207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:53.506667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:53.507747 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] PATH_INFO: `/v3/users/765e35da515c4e03a3fa2d95e5270b36` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:53.509217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765e35da515c4e03a3fa2d95e5270b36)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:53.511606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:53.577517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765e35da515c4e03a3fa2d95e5270b36'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:53.587784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765e35da515c4e03a3fa2d95e5270b36'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:53.589253 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765e35da515c4e03a3fa2d95e5270b36'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:53.591773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765e35da515c4e03a3fa2d95e5270b36'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:53.600786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765e35da515c4e03a3fa2d95e5270b36'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:53.644773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1034/2049] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:53 2022] DELETE /identity/v3/users/765e35da515c4e03a3fa2d95e5270b36 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:53.650041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165bc8-288e-47e7-b0b9-7dc48bf72710 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:53.650588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165bc8-288e-47e7-b0b9-7dc48bf72710 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:53.651049 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165bc8-288e-47e7-b0b9-7dc48bf72710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:53.680947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-2a165bc8-288e-47e7-b0b9-7dc48bf72710 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:53.682271 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2a165bc8-288e-47e7-b0b9-7dc48bf72710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:53.736910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:53.793939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1016/2050] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:53.807134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:53.808927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:53.884043 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e8e99-dc5c-4cd3-903d-414a239309e0 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:53.887820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1379c3-bf0a-4e2f-a305-7e126a2a71ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:53.888440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1379c3-bf0a-4e2f-a305-7e126a2a71ca service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:53.888740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1379c3-bf0a-4e2f-a305-7e126a2a71ca service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:53.888984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1379c3-bf0a-4e2f-a305-7e126a2a71ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:53.898661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1379c3-bf0a-4e2f-a305-7e126a2a71ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:53.900147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1379c3-bf0a-4e2f-a305-7e126a2a71ca service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:53.910869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1035/2051] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:51:54.202015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165bc8-288e-47e7-b0b9-7dc48bf72710 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:54.203609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2a165bc8-288e-47e7-b0b9-7dc48bf72710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:54.222406 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165bc8-288e-47e7-b0b9-7dc48bf72710 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:54.229792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:54.230819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:54.231522 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:54.231941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] PATH_INFO: `/v3/projects/5e69d14f70214d82afb96820531bb4b4` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:54.233669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e69d14f70214d82afb96820531bb4b4)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:54.236076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:54.287099 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e69d14f70214d82afb96820531bb4b4', 'request_id': 'req-faaa8ebd-645e-41b9-a849-1d12165207b8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:54.293517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e69d14f70214d82afb96820531bb4b4', 'request_id': 'req-faaa8ebd-645e-41b9-a849-1d12165207b8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:54.302106 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e69d14f70214d82afb96820531bb4b4', 'request_id': 'req-faaa8ebd-645e-41b9-a849-1d12165207b8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:54.313433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] The token cache is being invalidate because project 5e69d14f70214d82afb96820531bb4b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:54.313738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:54.314386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-faaa8ebd-645e-41b9-a849-1d12165207b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:54.315935 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1017/2052] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:54 2022] DELETE /identity/v3/projects/5e69d14f70214d82afb96820531bb4b4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:54.321312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7b487-e520-4814-ab35-49252096b7c8 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:54.322303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7b487-e520-4814-ab35-49252096b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:54.322915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7b487-e520-4814-ab35-49252096b7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:54.344490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-29a7b487-e520-4814-ab35-49252096b7c8 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:54.345933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-29a7b487-e520-4814-ab35-49252096b7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:54.388172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:54.417541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1036/2053] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:54.427460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e535d9-79d0-4de4-ba4b-568f22f13aef None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:54.427819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e535d9-79d0-4de4-ba4b-568f22f13aef None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:54.428163 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e535d9-79d0-4de4-ba4b-568f22f13aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:54.450583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-59e535d9-79d0-4de4-ba4b-568f22f13aef None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:54.451937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-59e535d9-79d0-4de4-ba4b-568f22f13aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:54.460530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1018/2054] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:54.465362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7b487-e520-4814-ab35-49252096b7c8 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:54.475190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7b487-e520-4814-ab35-49252096b7c8 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:54.479890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffeb056-c3d8-41d4-b530-bf8cb7451367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:54.480493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffeb056-c3d8-41d4-b530-bf8cb7451367 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:54.480773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffeb056-c3d8-41d4-b530-bf8cb7451367 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:54.481045 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffeb056-c3d8-41d4-b530-bf8cb7451367 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:54.481692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffeb056-c3d8-41d4-b530-bf8cb7451367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:54.482092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffeb056-c3d8-41d4-b530-bf8cb7451367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:54.483706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffeb056-c3d8-41d4-b530-bf8cb7451367 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:54.497052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1037/2055] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:51:54.501241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e535d9-79d0-4de4-ba4b-568f22f13aef None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:54.511980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e535d9-79d0-4de4-ba4b-568f22f13aef None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:54.516790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22324028-ede2-4793-ad5a-0a725a4d8b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:54.517482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22324028-ede2-4793-ad5a-0a725a4d8b3b admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:54.517830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22324028-ede2-4793-ad5a-0a725a4d8b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:54.518166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22324028-ede2-4793-ad5a-0a725a4d8b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:54.518866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22324028-ede2-4793-ad5a-0a725a4d8b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:54.520979 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22324028-ede2-4793-ad5a-0a725a4d8b3b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:54.553235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1019/2056] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:54 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:54.554375 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffeb056-c3d8-41d4-b530-bf8cb7451367 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:54.565892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffeb056-c3d8-41d4-b530-bf8cb7451367 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:54.628589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305a312-46d6-4ac0-8514-bada00afd2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:54.629575 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a312-46d6-4ac0-8514-bada00afd2be admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:54.629848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a312-46d6-4ac0-8514-bada00afd2be admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:54.630124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a312-46d6-4ac0-8514-bada00afd2be admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:54.630772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305a312-46d6-4ac0-8514-bada00afd2be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:54.632728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305a312-46d6-4ac0-8514-bada00afd2be admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:54.659882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1038/2057] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:54 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:51:54.661674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22324028-ede2-4793-ad5a-0a725a4d8b3b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:54.673317 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22324028-ede2-4793-ad5a-0a725a4d8b3b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:54.679191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1871478-cdcb-48cf-84ad-1cd702f4e8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:54.680018 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1871478-cdcb-48cf-84ad-1cd702f4e8bc admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:54.680404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1871478-cdcb-48cf-84ad-1cd702f4e8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:54.680784 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1871478-cdcb-48cf-84ad-1cd702f4e8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:54.681536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1871478-cdcb-48cf-84ad-1cd702f4e8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:54.683379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1871478-cdcb-48cf-84ad-1cd702f4e8bc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:54.697500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1020/2058] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:54.699401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305a312-46d6-4ac0-8514-bada00afd2be admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:54.710281 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305a312-46d6-4ac0-8514-bada00afd2be admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:54.715090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7a317-1624-4145-a630-af148b9cb96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:54.715794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7a317-1624-4145-a630-af148b9cb96b admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:54.716256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7a317-1624-4145-a630-af148b9cb96b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:54.716545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7a317-1624-4145-a630-af148b9cb96b admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:54.717195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7a317-1624-4145-a630-af148b9cb96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:54.718866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7a317-1624-4145-a630-af148b9cb96b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:54.731470 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1039/2059] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:54.735664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1871478-cdcb-48cf-84ad-1cd702f4e8bc admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:54.747037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1871478-cdcb-48cf-84ad-1cd702f4e8bc admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:54.752919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a8f7-eae5-4891-8d2c-0b548cbc6e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:54.754245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a8f7-eae5-4891-8d2c-0b548cbc6e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:54.754245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a8f7-eae5-4891-8d2c-0b548cbc6e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:54.754448 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a8f7-eae5-4891-8d2c-0b548cbc6e1e admin admin] PATH_INFO: `/v3/projects/141f293c6e8547e093ccf156540a9cb0/users/3e3c3b18d5f34e96b4fa99fa3f6c0599/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:54.773491 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85a8f7-eae5-4891-8d2c-0b548cbc6e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=141f293c6e8547e093ccf156540a9cb0, user_id=3e3c3b18d5f34e96b4fa99fa3f6c0599, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:54.776722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85a8f7-eae5-4891-8d2c-0b548cbc6e1e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:54.813711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1021/2060] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:54 2022] PUT /identity/v3/projects/141f293c6e8547e093ccf156540a9cb0/users/3e3c3b18d5f34e96b4fa99fa3f6c0599/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:51:54.815517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454002a-ad9b-4326-8385-dbeef99a5659 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:54.815805 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454002a-ad9b-4326-8385-dbeef99a5659 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:54.816083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454002a-ad9b-4326-8385-dbeef99a5659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:54.860154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a454002a-ad9b-4326-8385-dbeef99a5659 None None] MFA Rules not processed for user `3e3c3b18d5f34e96b4fa99fa3f6c0599`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:54.861393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a454002a-ad9b-4326-8385-dbeef99a5659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:54.948626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1040/2061] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:54.961263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a8f7-eae5-4891-8d2c-0b548cbc6e1e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:54.963446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9e85a8f7-eae5-4891-8d2c-0b548cbc6e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:55.031506 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:55.039646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a8f7-eae5-4891-8d2c-0b548cbc6e1e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:55.044716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a2c8b-a3c5-4dd5-8546-b1162868fd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:55.045609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a2c8b-a3c5-4dd5-8546-b1162868fd57 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:55.045930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a2c8b-a3c5-4dd5-8546-b1162868fd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:55.059770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a2c8b-a3c5-4dd5-8546-b1162868fd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:55.073641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a2c8b-a3c5-4dd5-8546-b1162868fd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:55.075546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a2c8b-a3c5-4dd5-8546-b1162868fd57 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:55.090463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1022/2062] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:56.089268 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454002a-ad9b-4326-8385-dbeef99a5659 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:56.090737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a454002a-ad9b-4326-8385-dbeef99a5659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:56.134206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:56.161081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454002a-ad9b-4326-8385-dbeef99a5659 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:56.165545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:56.166177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:56.166456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:56.166730 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] PATH_INFO: `/v3/users/47537307d40d49cfbc032c32bd9f9dbc` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:56.167864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47537307d40d49cfbc032c32bd9f9dbc)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:56.169773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:56.217117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47537307d40d49cfbc032c32bd9f9dbc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:56.224715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47537307d40d49cfbc032c32bd9f9dbc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:56.225400 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47537307d40d49cfbc032c32bd9f9dbc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:56.226008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47537307d40d49cfbc032c32bd9f9dbc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:56.233723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47537307d40d49cfbc032c32bd9f9dbc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:56.251750 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1041/2063] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:51:56 2022] DELETE /identity/v3/users/47537307d40d49cfbc032c32bd9f9dbc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:56.256185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e41d8-4184-4fc0-b6ae-07585053d39a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:56.256637 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e41d8-4184-4fc0-b6ae-07585053d39a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:56.256755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e41d8-4184-4fc0-b6ae-07585053d39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:56.279989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-344e41d8-4184-4fc0-b6ae-07585053d39a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:56.281199 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-344e41d8-4184-4fc0-b6ae-07585053d39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:56.340083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1023/2064] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:56.350288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:56.352011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:56.412068 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9eaf-18c6-4390-8419-b0542696478d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:56.416063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d4ed3-c6ab-4487-9567-3b9739e5edbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:56.416813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d4ed3-c6ab-4487-9567-3b9739e5edbf service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:56.417095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d4ed3-c6ab-4487-9567-3b9739e5edbf service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:56.417363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d4ed3-c6ab-4487-9567-3b9739e5edbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:56.426845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d4ed3-c6ab-4487-9567-3b9739e5edbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:56.428295 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d4ed3-c6ab-4487-9567-3b9739e5edbf service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:56.442050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1042/2065] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:56.787801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e41d8-4184-4fc0-b6ae-07585053d39a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:56.789219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-344e41d8-4184-4fc0-b6ae-07585053d39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:56.801320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e41d8-4184-4fc0-b6ae-07585053d39a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:56.806399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:56.807343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:56.807487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:56.807673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] PATH_INFO: `/v3/projects/56521d5f697b43978a75bff9205fa1cd` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:56.808842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56521d5f697b43978a75bff9205fa1cd)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:56.812046 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:56.865449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56521d5f697b43978a75bff9205fa1cd', 'request_id': 'req-6893570b-d769-4d61-97f1-2a9e994dbfd3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:56.871803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56521d5f697b43978a75bff9205fa1cd', 'request_id': 'req-6893570b-d769-4d61-97f1-2a9e994dbfd3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:56.880483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56521d5f697b43978a75bff9205fa1cd', 'request_id': 'req-6893570b-d769-4d61-97f1-2a9e994dbfd3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:56.890979 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] The token cache is being invalidate because project 56521d5f697b43978a75bff9205fa1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:51:56.891266 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:56.891937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6893570b-d769-4d61-97f1-2a9e994dbfd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:51:56.893457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1024/2066] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:51:56 2022] DELETE /identity/v3/projects/56521d5f697b43978a75bff9205fa1cd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:56.899162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eadf1f-4da5-476d-a7a5-76a497d83e72 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:56.899485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eadf1f-4da5-476d-a7a5-76a497d83e72 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:56.899770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eadf1f-4da5-476d-a7a5-76a497d83e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:56.919872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-82eadf1f-4da5-476d-a7a5-76a497d83e72 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:56.921073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-82eadf1f-4da5-476d-a7a5-76a497d83e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:56.976075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:56.987426 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1043/2067] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:56.996157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf41aef-1e53-4d0f-a040-b61ce2f4da89 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:56.996453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf41aef-1e53-4d0f-a040-b61ce2f4da89 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:56.996974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf41aef-1e53-4d0f-a040-b61ce2f4da89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:57.019507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-eaf41aef-1e53-4d0f-a040-b61ce2f4da89 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:57.021398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-eaf41aef-1e53-4d0f-a040-b61ce2f4da89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:57.029625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1025/2068] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:57.033837 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eadf1f-4da5-476d-a7a5-76a497d83e72 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:57.043627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eadf1f-4da5-476d-a7a5-76a497d83e72 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:57.056468 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b316b3d-ac13-4606-9ecd-53aec70c9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:57.057123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b316b3d-ac13-4606-9ecd-53aec70c9d5e admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:57.057460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b316b3d-ac13-4606-9ecd-53aec70c9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:57.057783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b316b3d-ac13-4606-9ecd-53aec70c9d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:57.059018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b316b3d-ac13-4606-9ecd-53aec70c9d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:51:57.059018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b316b3d-ac13-4606-9ecd-53aec70c9d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:57.061052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b316b3d-ac13-4606-9ecd-53aec70c9d5e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:57.077392 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1044/2069] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:51:57.082021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf41aef-1e53-4d0f-a040-b61ce2f4da89 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:57.094989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf41aef-1e53-4d0f-a040-b61ce2f4da89 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:57.102616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7abca-94bb-4a11-816d-f4e0d9954faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:57.103946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7abca-94bb-4a11-816d-f4e0d9954faa admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:57.104387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7abca-94bb-4a11-816d-f4e0d9954faa admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:57.104765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7abca-94bb-4a11-816d-f4e0d9954faa admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:57.105692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7abca-94bb-4a11-816d-f4e0d9954faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:57.109532 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7abca-94bb-4a11-816d-f4e0d9954faa admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:57.160305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1026/2070] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:51:57 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:57.164812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b316b3d-ac13-4606-9ecd-53aec70c9d5e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:57.175013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b316b3d-ac13-4606-9ecd-53aec70c9d5e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:57.247444 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac994a5f-4542-44e9-816d-8c3bc91a858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:57.249743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac994a5f-4542-44e9-816d-8c3bc91a858d admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:57.249961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac994a5f-4542-44e9-816d-8c3bc91a858d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:57.250300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac994a5f-4542-44e9-816d-8c3bc91a858d admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:57.251025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac994a5f-4542-44e9-816d-8c3bc91a858d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:57.253249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac994a5f-4542-44e9-816d-8c3bc91a858d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:57.281455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1045/2071] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:51:57 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:51:57.282711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7abca-94bb-4a11-816d-f4e0d9954faa admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:57.294216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7abca-94bb-4a11-816d-f4e0d9954faa admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:57.299658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54ae22-cb4b-4ff3-bf13-5e2e3c577109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:57.300280 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54ae22-cb4b-4ff3-bf13-5e2e3c577109 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:57.301151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54ae22-cb4b-4ff3-bf13-5e2e3c577109 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:57.301435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54ae22-cb4b-4ff3-bf13-5e2e3c577109 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:57.302088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54ae22-cb4b-4ff3-bf13-5e2e3c577109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:57.303740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54ae22-cb4b-4ff3-bf13-5e2e3c577109 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:57.314375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1027/2072] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:51:57.319147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac994a5f-4542-44e9-816d-8c3bc91a858d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:57.329672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac994a5f-4542-44e9-816d-8c3bc91a858d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:57.334686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88952cf-fafb-4a3e-8835-519d2a282f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:57.335313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88952cf-fafb-4a3e-8835-519d2a282f70 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:57.335606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88952cf-fafb-4a3e-8835-519d2a282f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:57.335882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88952cf-fafb-4a3e-8835-519d2a282f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:57.336582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88952cf-fafb-4a3e-8835-519d2a282f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:57.338181 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88952cf-fafb-4a3e-8835-519d2a282f70 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:57.354759 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1046/2073] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:51:57.356059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54ae22-cb4b-4ff3-bf13-5e2e3c577109 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:57.367795 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54ae22-cb4b-4ff3-bf13-5e2e3c577109 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:57.373243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794af063-7b4c-4daa-8d5f-27efd4939d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:57.373916 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af063-7b4c-4daa-8d5f-27efd4939d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:57.374207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af063-7b4c-4daa-8d5f-27efd4939d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:57.374486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af063-7b4c-4daa-8d5f-27efd4939d47 admin admin] PATH_INFO: `/v3/projects/f393f6d4c4744a1b9dca939b1b3fbb30/users/3c5997d4c1c2406bbabc93e9bb663da5/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:57.391275 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794af063-7b4c-4daa-8d5f-27efd4939d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f393f6d4c4744a1b9dca939b1b3fbb30, user_id=3c5997d4c1c2406bbabc93e9bb663da5, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:57.394092 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794af063-7b4c-4daa-8d5f-27efd4939d47 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:57.407611 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1028/2074] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:51:57 2022] PUT /identity/v3/projects/f393f6d4c4744a1b9dca939b1b3fbb30/users/3c5997d4c1c2406bbabc93e9bb663da5/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:51:57.417978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005b52-3295-4f4d-9c7e-e0521bbcbe47 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:57.418434 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005b52-3295-4f4d-9c7e-e0521bbcbe47 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:57.418717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005b52-3295-4f4d-9c7e-e0521bbcbe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:57.447451 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-36005b52-3295-4f4d-9c7e-e0521bbcbe47 None None] MFA Rules not processed for user `3c5997d4c1c2406bbabc93e9bb663da5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:57.448664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-36005b52-3295-4f4d-9c7e-e0521bbcbe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:57.530355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1047/2075] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:51:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:51:57.541939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794af063-7b4c-4daa-8d5f-27efd4939d47 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:57.543671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-794af063-7b4c-4daa-8d5f-27efd4939d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:57.563426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:57.618840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794af063-7b4c-4daa-8d5f-27efd4939d47 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:57.622538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4f8da-db1d-415a-ad19-b10a32c892ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:57.623151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4f8da-db1d-415a-ad19-b10a32c892ec service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:57.623481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4f8da-db1d-415a-ad19-b10a32c892ec service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:57.623760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4f8da-db1d-415a-ad19-b10a32c892ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:57.633418 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4f8da-db1d-415a-ad19-b10a32c892ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:57.634962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4f8da-db1d-415a-ad19-b10a32c892ec service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:57.644207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1029/2076] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:59.629314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d27c01-1e06-41f8-8e99-7840afd9c552 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:59.629835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d27c01-1e06-41f8-8e99-7840afd9c552 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:59.629921 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d27c01-1e06-41f8-8e99-7840afd9c552 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:59.631209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1048/2077] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:51:59.640994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e4bb2-d791-4016-91d7-7dcecb0634d4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:59.641503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e4bb2-d791-4016-91d7-7dcecb0634d4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:59.641636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e4bb2-d791-4016-91d7-7dcecb0634d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:59.662554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-274e4bb2-d791-4016-91d7-7dcecb0634d4 None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:59.664441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-274e4bb2-d791-4016-91d7-7dcecb0634d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:59.749363 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1030/2078] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:51:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:51:59.757134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d27c01-1e06-41f8-8e99-7840afd9c552 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:51:59.759032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-71d27c01-1e06-41f8-8e99-7840afd9c552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:51:59.819815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d27c01-1e06-41f8-8e99-7840afd9c552 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:51:59.823373 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f475c-0481-4c34-b144-f0e5a06d6a9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c894579b2b2943409412afbbfe779aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:51:59.823990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f475c-0481-4c34-b144-f0e5a06d6a9a service glance] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:59.824300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f475c-0481-4c34-b144-f0e5a06d6a9a service glance] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:59.824580 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f475c-0481-4c34-b144-f0e5a06d6a9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:59.834014 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:51:59.836406 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f475c-0481-4c34-b144-f0e5a06d6a9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:51:59.837891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f475c-0481-4c34-b144-f0e5a06d6a9a service glance] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:51:59.850587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1049/2079] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:51:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:51:59.933672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f599-36d5-4e58-9b8c-b7a36d376048 None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:59.934014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f599-36d5-4e58-9b8c-b7a36d376048 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:59.934623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f599-36d5-4e58-9b8c-b7a36d376048 None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:59.935764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1031/2080] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:51:59.942247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed13a6d-491d-4ec0-bbaa-320a738e7506 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:51:59.942920 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed13a6d-491d-4ec0-bbaa-320a738e7506 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:51:59.943476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed13a6d-491d-4ec0-bbaa-320a738e7506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:51:59.965074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8ed13a6d-491d-4ec0-bbaa-320a738e7506 None None] MFA Rules not processed for user `dc59d3cc1fbc4d4382bffd8ae93075e1`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:51:59.966486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8ed13a6d-491d-4ec0-bbaa-320a738e7506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:00.025246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1050/2081] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:51:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:00.037125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329f599-36d5-4e58-9b8c-b7a36d376048 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:00.038845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c329f599-36d5-4e58-9b8c-b7a36d376048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:00.051809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329f599-36d5-4e58-9b8c-b7a36d376048 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:00.055494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286b460-af53-4313-8437-d4d98714f5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:00.056101 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286b460-af53-4313-8437-d4d98714f5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:00.056433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286b460-af53-4313-8437-d4d98714f5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:00.057110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286b460-af53-4313-8437-d4d98714f5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:00.064201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286b460-af53-4313-8437-d4d98714f5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:00.065634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286b460-af53-4313-8437-d4d98714f5b5 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:00.074446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1032/2082] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:00.190541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316fa5e-d420-4ef9-aa1e-039e1663e20b None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:00.190829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316fa5e-d420-4ef9-aa1e-039e1663e20b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:00.191123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316fa5e-d420-4ef9-aa1e-039e1663e20b None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:00.193026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1051/2083] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:52:00.198565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab7eba-4efc-4d9d-be37-294b730d303d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:00.198874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab7eba-4efc-4d9d-be37-294b730d303d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:00.199153 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab7eba-4efc-4d9d-be37-294b730d303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:00.219162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-daab7eba-4efc-4d9d-be37-294b730d303d None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:00.220616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-daab7eba-4efc-4d9d-be37-294b730d303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:00.230162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1033/2084] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:52:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:00.241050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316fa5e-d420-4ef9-aa1e-039e1663e20b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:00.251618 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316fa5e-d420-4ef9-aa1e-039e1663e20b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:00.255681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10f6f7-eca8-488b-bcc5-1421edaa2088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:00.256265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10f6f7-eca8-488b-bcc5-1421edaa2088 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:00.256542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10f6f7-eca8-488b-bcc5-1421edaa2088 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:00.256816 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10f6f7-eca8-488b-bcc5-1421edaa2088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:00.266509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10f6f7-eca8-488b-bcc5-1421edaa2088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:00.267969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10f6f7-eca8-488b-bcc5-1421edaa2088 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:00.278534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1052/2085] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:03.696085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc10189-f132-4ae7-b86e-6f492babc921 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:03.696630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc10189-f132-4ae7-b86e-6f492babc921 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:03.696888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc10189-f132-4ae7-b86e-6f492babc921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:03.736080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-2fc10189-f132-4ae7-b86e-6f492babc921 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:03.739527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2fc10189-f132-4ae7-b86e-6f492babc921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:03.855257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1034/2086] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:52:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:03.885922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10f6f7-eca8-488b-bcc5-1421edaa2088 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:03.887625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1c10f6f7-eca8-488b-bcc5-1421edaa2088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:04.063352 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10f6f7-eca8-488b-bcc5-1421edaa2088 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:04.070110 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5a692-a9d7-473e-95bd-fab568fce339 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:04.070850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a692-a9d7-473e-95bd-fab568fce339 service swift] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:04.071137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a692-a9d7-473e-95bd-fab568fce339 service swift] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:04.071452 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a692-a9d7-473e-95bd-fab568fce339 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:04.083632 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5a692-a9d7-473e-95bd-fab568fce339 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:04.086606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5a692-a9d7-473e-95bd-fab568fce339 service swift] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:04.109589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1053/2087] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:52:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:52:08.660720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc10189-f132-4ae7-b86e-6f492babc921 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:08.721672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:08.763749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc10189-f132-4ae7-b86e-6f492babc921 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:08.770088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:08.770834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:08.771039 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:08.771398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] PATH_INFO: `/v3/users/3c5997d4c1c2406bbabc93e9bb663da5` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:08.772761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5997d4c1c2406bbabc93e9bb663da5)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:08.774787 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:08.831117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5997d4c1c2406bbabc93e9bb663da5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:08.838407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5997d4c1c2406bbabc93e9bb663da5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:08.839256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5997d4c1c2406bbabc93e9bb663da5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:08.839915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5997d4c1c2406bbabc93e9bb663da5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:08.848044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5997d4c1c2406bbabc93e9bb663da5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:08.867193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1035/2088] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:52:08 2022] DELETE /identity/v3/users/3c5997d4c1c2406bbabc93e9bb663da5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:52:08.871700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41e557-598f-4cd0-84fe-fa92d4e219c7 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:08.872216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41e557-598f-4cd0-84fe-fa92d4e219c7 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:08.872324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41e557-598f-4cd0-84fe-fa92d4e219c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:08.891532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-1d41e557-598f-4cd0-84fe-fa92d4e219c7 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:08.892813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1d41e557-598f-4cd0-84fe-fa92d4e219c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:08.956188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1054/2089] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:08.966063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:08.967559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:09.024146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fb7bf-1da4-49cb-ad23-33f0d006ec35 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:09.028343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19c31d-c236-4ae2-8d1b-6d56cc25835a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:09.029062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19c31d-c236-4ae2-8d1b-6d56cc25835a service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:09.029391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19c31d-c236-4ae2-8d1b-6d56cc25835a service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:09.029669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19c31d-c236-4ae2-8d1b-6d56cc25835a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:09.041766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19c31d-c236-4ae2-8d1b-6d56cc25835a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:09.043609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19c31d-c236-4ae2-8d1b-6d56cc25835a service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:09.057731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1036/2090] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:09.509619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41e557-598f-4cd0-84fe-fa92d4e219c7 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:09.511509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1d41e557-598f-4cd0-84fe-fa92d4e219c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:09.529002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41e557-598f-4cd0-84fe-fa92d4e219c7 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:09.541657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:09.542771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:09.543709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:09.544208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] PATH_INFO: `/v3/projects/f393f6d4c4744a1b9dca939b1b3fbb30` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:09.545798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f393f6d4c4744a1b9dca939b1b3fbb30)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:09.549942 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:09.604619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:09.647071 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f393f6d4c4744a1b9dca939b1b3fbb30', 'request_id': 'req-a3a38fb8-be73-4e8c-9195-9ced8df697dc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:09.656937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f393f6d4c4744a1b9dca939b1b3fbb30', 'request_id': 'req-a3a38fb8-be73-4e8c-9195-9ced8df697dc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:09.666507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f393f6d4c4744a1b9dca939b1b3fbb30', 'request_id': 'req-a3a38fb8-be73-4e8c-9195-9ced8df697dc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:09.677885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] The token cache is being invalidate because project f393f6d4c4744a1b9dca939b1b3fbb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:52:09.678181 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:09.678862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a3a38fb8-be73-4e8c-9195-9ced8df697dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:09.680390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1055/2091] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:52:09 2022] DELETE /identity/v3/projects/f393f6d4c4744a1b9dca939b1b3fbb30 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:52:09.685392 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ffe9d-6b85-42fb-ae92-129e77beeb5a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:09.685936 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ffe9d-6b85-42fb-ae92-129e77beeb5a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:09.685936 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ffe9d-6b85-42fb-ae92-129e77beeb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:09.715500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-a00ffe9d-6b85-42fb-ae92-129e77beeb5a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:09.716880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a00ffe9d-6b85-42fb-ae92-129e77beeb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:09.773380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:09.788745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1037/2092] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:52:09.797998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3e532-f8a2-4294-b7cd-cd436f17412a None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:09.798287 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3e532-f8a2-4294-b7cd-cd436f17412a None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:09.798570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3e532-f8a2-4294-b7cd-cd436f17412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:09.818806 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-47d3e532-f8a2-4294-b7cd-cd436f17412a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:09.820075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-47d3e532-f8a2-4294-b7cd-cd436f17412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:09.830511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1056/2093] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:09.837927 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ffe9d-6b85-42fb-ae92-129e77beeb5a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:09.849617 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ffe9d-6b85-42fb-ae92-129e77beeb5a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:09.854564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f5410-8468-4ee4-ac8f-123c77f6c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:09.855191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f5410-8468-4ee4-ac8f-123c77f6c89d admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:09.855524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f5410-8468-4ee4-ac8f-123c77f6c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:09.855801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f5410-8468-4ee4-ac8f-123c77f6c89d admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:09.856458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f5410-8468-4ee4-ac8f-123c77f6c89d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:52:09.856770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f5410-8468-4ee4-ac8f-123c77f6c89d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:09.858707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f5410-8468-4ee4-ac8f-123c77f6c89d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:09.879323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1038/2094] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:52:09.883151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3e532-f8a2-4294-b7cd-cd436f17412a None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:09.893081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3e532-f8a2-4294-b7cd-cd436f17412a None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:09.898799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006007-6cff-44aa-bc1e-360bd83a2885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:09.899718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006007-6cff-44aa-bc1e-360bd83a2885 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:09.900158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006007-6cff-44aa-bc1e-360bd83a2885 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:09.900440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006007-6cff-44aa-bc1e-360bd83a2885 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:09.901075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca006007-6cff-44aa-bc1e-360bd83a2885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:09.903163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca006007-6cff-44aa-bc1e-360bd83a2885 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:09.951472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1057/2095] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:52:09 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:52:09.955636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f5410-8468-4ee4-ac8f-123c77f6c89d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:09.970592 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f5410-8468-4ee4-ac8f-123c77f6c89d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:10.029180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b645-fc48-463e-85d9-cfb4db58ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:10.029847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b645-fc48-463e-85d9-cfb4db58ecea admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:10.030530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b645-fc48-463e-85d9-cfb4db58ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:10.030839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b645-fc48-463e-85d9-cfb4db58ecea admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:10.031666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5b645-fc48-463e-85d9-cfb4db58ecea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:10.034265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5b645-fc48-463e-85d9-cfb4db58ecea admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:10.058878 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1039/2096] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:52:09 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:52:10.063258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006007-6cff-44aa-bc1e-360bd83a2885 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:10.074307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006007-6cff-44aa-bc1e-360bd83a2885 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:10.078987 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6c59c-e30f-44ed-b146-46df4923f4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:10.079620 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6c59c-e30f-44ed-b146-46df4923f4fe admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:10.079904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6c59c-e30f-44ed-b146-46df4923f4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:10.080182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6c59c-e30f-44ed-b146-46df4923f4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:10.081073 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6c59c-e30f-44ed-b146-46df4923f4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:10.082724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6c59c-e30f-44ed-b146-46df4923f4fe admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:10.093279 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1058/2097] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:52:10.097355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b645-fc48-463e-85d9-cfb4db58ecea admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:10.108543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b645-fc48-463e-85d9-cfb4db58ecea admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:10.112170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b29ea-b178-4fda-ae44-177de80306f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:10.113279 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b29ea-b178-4fda-ae44-177de80306f1 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:10.113557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b29ea-b178-4fda-ae44-177de80306f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:10.113825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b29ea-b178-4fda-ae44-177de80306f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:10.114455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b29ea-b178-4fda-ae44-177de80306f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:10.116084 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b29ea-b178-4fda-ae44-177de80306f1 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:10.127332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1040/2098] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:52:10.131244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6c59c-e30f-44ed-b146-46df4923f4fe admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:10.141606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6c59c-e30f-44ed-b146-46df4923f4fe admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:10.146850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04334-e80d-4fd7-b7d7-87c332a662b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:10.147538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04334-e80d-4fd7-b7d7-87c332a662b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:10.147822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04334-e80d-4fd7-b7d7-87c332a662b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:10.148119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04334-e80d-4fd7-b7d7-87c332a662b4 admin admin] PATH_INFO: `/v3/projects/92313372ea534925ad95ddd64321b8a1/users/471702083964469194e11ab184e87c93/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:10.163502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd04334-e80d-4fd7-b7d7-87c332a662b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92313372ea534925ad95ddd64321b8a1, user_id=471702083964469194e11ab184e87c93, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:10.166191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd04334-e80d-4fd7-b7d7-87c332a662b4 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:10.180566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1059/2099] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:52:10 2022] PUT /identity/v3/projects/92313372ea534925ad95ddd64321b8a1/users/471702083964469194e11ab184e87c93/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:52:10.185845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f96d-2e02-425e-8555-7ea7cfdcacfe None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:10.186132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f96d-2e02-425e-8555-7ea7cfdcacfe None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:10.186409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f96d-2e02-425e-8555-7ea7cfdcacfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:10.205377 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-aaf4f96d-2e02-425e-8555-7ea7cfdcacfe None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:10.207446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-aaf4f96d-2e02-425e-8555-7ea7cfdcacfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:10.266765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1041/2100] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:52:10.277070 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04334-e80d-4fd7-b7d7-87c332a662b4 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:10.278904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-dcd04334-e80d-4fd7-b7d7-87c332a662b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:10.353732 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04334-e80d-4fd7-b7d7-87c332a662b4 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:10.357378 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e4998-d264-47bf-94a3-222e5ba06466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:10.358053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e4998-d264-47bf-94a3-222e5ba06466 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:10.358338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e4998-d264-47bf-94a3-222e5ba06466 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:10.358617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e4998-d264-47bf-94a3-222e5ba06466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:10.368448 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e4998-d264-47bf-94a3-222e5ba06466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:10.369888 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e4998-d264-47bf-94a3-222e5ba06466 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:10.383544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1060/2101] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:15.940049 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923b855-0107-45e2-81a1-1964873fad93 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:15.940664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923b855-0107-45e2-81a1-1964873fad93 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:15.940764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923b855-0107-45e2-81a1-1964873fad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:15.969458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-1923b855-0107-45e2-81a1-1964873fad93 None None] MFA Rules not processed for user `471702083964469194e11ab184e87c93`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:15.970727 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1923b855-0107-45e2-81a1-1964873fad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:16.024867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:16.045930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1042/2102] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:16.051473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e4998-d264-47bf-94a3-222e5ba06466 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:16.063509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e4998-d264-47bf-94a3-222e5ba06466 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:16.068415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9650be4-58c0-4718-8643-6b6bc1586a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:16.069178 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650be4-58c0-4718-8643-6b6bc1586a01 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:16.069465 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650be4-58c0-4718-8643-6b6bc1586a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:16.069744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650be4-58c0-4718-8643-6b6bc1586a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:16.070536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9650be4-58c0-4718-8643-6b6bc1586a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:16.073085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9650be4-58c0-4718-8643-6b6bc1586a01 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:16.110539 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1061/2103] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:52:16 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:52:16.114674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923b855-0107-45e2-81a1-1964873fad93 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:16.126909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923b855-0107-45e2-81a1-1964873fad93 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:16.203965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab017e-a93b-4e83-8ef0-0c4cce165b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:16.204613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab017e-a93b-4e83-8ef0-0c4cce165b8f admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:16.204890 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab017e-a93b-4e83-8ef0-0c4cce165b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:16.205169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab017e-a93b-4e83-8ef0-0c4cce165b8f admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:16.206602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab017e-a93b-4e83-8ef0-0c4cce165b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:16.208579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab017e-a93b-4e83-8ef0-0c4cce165b8f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:16.238763 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1043/2104] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:52:16 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:52:16.239994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9650be4-58c0-4718-8643-6b6bc1586a01 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:16.253879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9650be4-58c0-4718-8643-6b6bc1586a01 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:16.258936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53d85c-ce8f-43dd-bfa3-31bca0730129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:16.259599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53d85c-ce8f-43dd-bfa3-31bca0730129 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:16.259885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53d85c-ce8f-43dd-bfa3-31bca0730129 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:16.260259 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53d85c-ce8f-43dd-bfa3-31bca0730129 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:16.260801 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53d85c-ce8f-43dd-bfa3-31bca0730129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:16.262710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53d85c-ce8f-43dd-bfa3-31bca0730129 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:16.281254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab017e-a93b-4e83-8ef0-0c4cce165b8f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:16.281712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1062/2105] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:52:16.295531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab017e-a93b-4e83-8ef0-0c4cce165b8f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:16.301513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b733c5-a340-48e7-9d60-7719564d8004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:16.302197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b733c5-a340-48e7-9d60-7719564d8004 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:16.302475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b733c5-a340-48e7-9d60-7719564d8004 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:16.302755 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b733c5-a340-48e7-9d60-7719564d8004 admin admin] PATH_INFO: `/v3/projects/0a3cbb3ec281446187e08cb3d2a0f078/users/734559b4525b416baf1fee51cf68b4cd/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:16.322337 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b733c5-a340-48e7-9d60-7719564d8004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3cbb3ec281446187e08cb3d2a0f078, user_id=734559b4525b416baf1fee51cf68b4cd, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:16.325052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b733c5-a340-48e7-9d60-7719564d8004 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:16.343564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1044/2106] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:52:16 2022] PUT /identity/v3/projects/0a3cbb3ec281446187e08cb3d2a0f078/users/734559b4525b416baf1fee51cf68b4cd/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:52:16.352932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53d85c-ce8f-43dd-bfa3-31bca0730129 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:16.371498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53d85c-ce8f-43dd-bfa3-31bca0730129 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:16.381197 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:16.446928 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a913a1-458d-49d2-8603-c3af25d671ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:16.447695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a913a1-458d-49d2-8603-c3af25d671ad admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:16.448046 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a913a1-458d-49d2-8603-c3af25d671ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:16.448391 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a913a1-458d-49d2-8603-c3af25d671ad admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:16.449111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a913a1-458d-49d2-8603-c3af25d671ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:16.450790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a913a1-458d-49d2-8603-c3af25d671ad admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:16.463162 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1063/2107] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:52:16.467435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b733c5-a340-48e7-9d60-7719564d8004 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:16.482221 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b733c5-a340-48e7-9d60-7719564d8004 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:16.488308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d2eb8-3d06-406d-8a81-6cd1b5288708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:16.489251 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d2eb8-3d06-406d-8a81-6cd1b5288708 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:16.489665 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d2eb8-3d06-406d-8a81-6cd1b5288708 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:16.489992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d2eb8-3d06-406d-8a81-6cd1b5288708 admin admin] PATH_INFO: `/v3/projects/0a3cbb3ec281446187e08cb3d2a0f078/users/734559b4525b416baf1fee51cf68b4cd/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:16.493378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d2eb8-3d06-406d-8a81-6cd1b5288708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3cbb3ec281446187e08cb3d2a0f078, user_id=734559b4525b416baf1fee51cf68b4cd, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:16.496603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d2eb8-3d06-406d-8a81-6cd1b5288708 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:16.512807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1045/2108] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:52:16 2022] PUT /identity/v3/projects/0a3cbb3ec281446187e08cb3d2a0f078/users/734559b4525b416baf1fee51cf68b4cd/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:52:23.053201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02f486-f738-4782-9050-6e7285a904b8 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:23.053765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02f486-f738-4782-9050-6e7285a904b8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:23.053765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02f486-f738-4782-9050-6e7285a904b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:23.087822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-4e02f486-f738-4782-9050-6e7285a904b8 None None] MFA Rules not processed for user `734559b4525b416baf1fee51cf68b4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:23.089498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4e02f486-f738-4782-9050-6e7285a904b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:23.197541 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1064/2109] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:23.211472 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d2eb8-3d06-406d-8a81-6cd1b5288708 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:23.213187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-179d2eb8-3d06-406d-8a81-6cd1b5288708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:23.340098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d2eb8-3d06-406d-8a81-6cd1b5288708 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:23.362575 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a39d0d-259a-4cdc-8ee9-baec78788a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:23.363570 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a39d0d-259a-4cdc-8ee9-baec78788a59 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:23.364264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a39d0d-259a-4cdc-8ee9-baec78788a59 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:23.364668 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a39d0d-259a-4cdc-8ee9-baec78788a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:23.416400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:23.439921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a39d0d-259a-4cdc-8ee9-baec78788a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:23.441708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a39d0d-259a-4cdc-8ee9-baec78788a59 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:23.452850 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1046/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:25.371797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac482-d968-4ced-9bd4-7ab41c9f0914 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:25.372408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac482-d968-4ced-9bd4-7ab41c9f0914 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:25.372408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac482-d968-4ced-9bd4-7ab41c9f0914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:25.392741 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-e43ac482-d968-4ced-9bd4-7ab41c9f0914 None None] MFA Rules not processed for user `471702083964469194e11ab184e87c93`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:25.394570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e43ac482-d968-4ced-9bd4-7ab41c9f0914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:25.401840 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1065/2111] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:29.108615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a39d0d-259a-4cdc-8ee9-baec78788a59 service nova] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:29.175760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a39d0d-259a-4cdc-8ee9-baec78788a59 service nova] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:29.179552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9ae0-485a-4b9c-ad5f-9952bcfba7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:29.180291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9ae0-485a-4b9c-ad5f-9952bcfba7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:29.180582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9ae0-485a-4b9c-ad5f-9952bcfba7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:29.180862 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9ae0-485a-4b9c-ad5f-9952bcfba7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:29.182630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bbba9ae0-485a-4b9c-ad5f-9952bcfba7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:29.254530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba9ae0-485a-4b9c-ad5f-9952bcfba7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:29.256194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba9ae0-485a-4b9c-ad5f-9952bcfba7d3 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:29.266289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1047/2112] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:29.724554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac482-d968-4ced-9bd4-7ab41c9f0914 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:29.726087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e43ac482-d968-4ced-9bd4-7ab41c9f0914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:29.821028 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac482-d968-4ced-9bd4-7ab41c9f0914 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:29.827877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:29.829211 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:29.829211 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:29.832007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] PATH_INFO: `/v3/users/3e3c3b18d5f34e96b4fa99fa3f6c0599` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:29.834631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3c3b18d5f34e96b4fa99fa3f6c0599)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:29.837137 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:29.880603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:29.913361 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3c3b18d5f34e96b4fa99fa3f6c0599'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:29.926058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3c3b18d5f34e96b4fa99fa3f6c0599'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:29.928063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3c3b18d5f34e96b4fa99fa3f6c0599'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:29.928699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3c3b18d5f34e96b4fa99fa3f6c0599'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:29.961226 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3c3b18d5f34e96b4fa99fa3f6c0599'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:29.982139 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1066/2113] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:52:29 2022] DELETE /identity/v3/users/3e3c3b18d5f34e96b4fa99fa3f6c0599 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:52:29.986486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5236bc-6379-4fa7-b3fc-1bf176515155 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:29.987408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5236bc-6379-4fa7-b3fc-1bf176515155 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:29.987694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5236bc-6379-4fa7-b3fc-1bf176515155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:30.011020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-bd5236bc-6379-4fa7-b3fc-1bf176515155 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:30.012071 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bd5236bc-6379-4fa7-b3fc-1bf176515155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:30.103652 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1048/2114] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:30.117441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:30.119262 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:30.191929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ea03e-d077-41dd-9345-07290739c88b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:30.196817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4718c-cc8d-492d-bb26-970140300efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:30.197437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4718c-cc8d-492d-bb26-970140300efc service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:30.197718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4718c-cc8d-492d-bb26-970140300efc service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:30.197992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4718c-cc8d-492d-bb26-970140300efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:30.209033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4718c-cc8d-492d-bb26-970140300efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:30.210648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4718c-cc8d-492d-bb26-970140300efc service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:30.222220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1067/2115] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:30.509874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5236bc-6379-4fa7-b3fc-1bf176515155 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:30.511197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bd5236bc-6379-4fa7-b3fc-1bf176515155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:30.526357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5236bc-6379-4fa7-b3fc-1bf176515155 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:30.572856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:30.573908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:30.573908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:30.574129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] PATH_INFO: `/v3/projects/141f293c6e8547e093ccf156540a9cb0` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:30.578576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] RBAC: Authorizing `identity:delete_project(project_id=141f293c6e8547e093ccf156540a9cb0)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:30.578576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:30.617972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:30.651839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141f293c6e8547e093ccf156540a9cb0', 'request_id': 'req-482f4628-6ca7-4ce8-8103-9d4392c0962d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:30.662328 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141f293c6e8547e093ccf156540a9cb0', 'request_id': 'req-482f4628-6ca7-4ce8-8103-9d4392c0962d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:30.685760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141f293c6e8547e093ccf156540a9cb0', 'request_id': 'req-482f4628-6ca7-4ce8-8103-9d4392c0962d'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:30.699000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] The token cache is being invalidate because project 141f293c6e8547e093ccf156540a9cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:52:30.699364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:30.700038 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-482f4628-6ca7-4ce8-8103-9d4392c0962d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:30.701448 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1049/2116] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:52:30 2022] DELETE /identity/v3/projects/141f293c6e8547e093ccf156540a9cb0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:52:30.707242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe4df-6cf6-41bc-8123-5d1432093fab None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:30.707625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe4df-6cf6-41bc-8123-5d1432093fab None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:30.707902 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe4df-6cf6-41bc-8123-5d1432093fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:30.730415 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bbafe4df-6cf6-41bc-8123-5d1432093fab None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:30.731699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bbafe4df-6cf6-41bc-8123-5d1432093fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:30.805640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1068/2117] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:52:30.813546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703de8e7-cc85-4b29-be19-b80972bcb36f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:30.813831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703de8e7-cc85-4b29-be19-b80972bcb36f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:30.814108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703de8e7-cc85-4b29-be19-b80972bcb36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:30.835712 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-703de8e7-cc85-4b29-be19-b80972bcb36f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:30.836833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-703de8e7-cc85-4b29-be19-b80972bcb36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:30.844761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1050/2118] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:52:30.849154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafe4df-6cf6-41bc-8123-5d1432093fab None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:30.859254 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafe4df-6cf6-41bc-8123-5d1432093fab None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:30.864537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc33749-6a59-4529-9164-f122ac9ad5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:30.865234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc33749-6a59-4529-9164-f122ac9ad5db admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:30.865903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc33749-6a59-4529-9164-f122ac9ad5db admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:30.865903 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc33749-6a59-4529-9164-f122ac9ad5db admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:30.866706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc33749-6a59-4529-9164-f122ac9ad5db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:52:30.867016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc33749-6a59-4529-9164-f122ac9ad5db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:30.868785 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc33749-6a59-4529-9164-f122ac9ad5db admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:30.886115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1069/2119] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:52:30.888486 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703de8e7-cc85-4b29-be19-b80972bcb36f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:30.899264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703de8e7-cc85-4b29-be19-b80972bcb36f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:30.904839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7e30f-ed85-4c52-a037-cc2fb13e4cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:30.905007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7e30f-ed85-4c52-a037-cc2fb13e4cdb admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:30.905263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7e30f-ed85-4c52-a037-cc2fb13e4cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:30.905536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7e30f-ed85-4c52-a037-cc2fb13e4cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:30.906170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7e30f-ed85-4c52-a037-cc2fb13e4cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:30.908484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7e30f-ed85-4c52-a037-cc2fb13e4cdb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:30.950545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1051/2120] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:52:30 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:52:30.951837 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc33749-6a59-4529-9164-f122ac9ad5db admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:30.962794 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc33749-6a59-4529-9164-f122ac9ad5db admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:30.998531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:31.026641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94951ba8-5e58-4f86-b994-e8c0029a5016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:31.027322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94951ba8-5e58-4f86-b994-e8c0029a5016 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:31.027612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94951ba8-5e58-4f86-b994-e8c0029a5016 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:31.027890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94951ba8-5e58-4f86-b994-e8c0029a5016 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:31.028528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94951ba8-5e58-4f86-b994-e8c0029a5016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:31.030521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94951ba8-5e58-4f86-b994-e8c0029a5016 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:31.055205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1070/2121] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:52:30 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:52:31.059042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7e30f-ed85-4c52-a037-cc2fb13e4cdb admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:31.071125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7e30f-ed85-4c52-a037-cc2fb13e4cdb admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:31.078553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e90a5-70cd-42c0-b759-dd4fff3c305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:31.078553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e90a5-70cd-42c0-b759-dd4fff3c305d admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:31.078553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e90a5-70cd-42c0-b759-dd4fff3c305d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:31.078553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e90a5-70cd-42c0-b759-dd4fff3c305d admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:31.078994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e90a5-70cd-42c0-b759-dd4fff3c305d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:31.079608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e90a5-70cd-42c0-b759-dd4fff3c305d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:31.090901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1052/2122] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:52:31.094919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94951ba8-5e58-4f86-b994-e8c0029a5016 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:31.105744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94951ba8-5e58-4f86-b994-e8c0029a5016 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:31.110502 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dd754-9e37-49ab-ae06-e573604c58c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:31.111112 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd754-9e37-49ab-ae06-e573604c58c6 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:31.111423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd754-9e37-49ab-ae06-e573604c58c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:31.112227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd754-9e37-49ab-ae06-e573604c58c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:31.112868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dd754-9e37-49ab-ae06-e573604c58c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:31.114474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dd754-9e37-49ab-ae06-e573604c58c6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:31.129317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1071/2123] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:52:31.138601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e90a5-70cd-42c0-b759-dd4fff3c305d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:31.150895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e90a5-70cd-42c0-b759-dd4fff3c305d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:31.156722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f60d4-1dda-4456-8872-f7d5f5dc8a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:31.157418 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f60d4-1dda-4456-8872-f7d5f5dc8a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:31.157712 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f60d4-1dda-4456-8872-f7d5f5dc8a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:31.157985 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f60d4-1dda-4456-8872-f7d5f5dc8a87 admin admin] PATH_INFO: `/v3/projects/0464d5a212274356a9b0698ac76cd96a/users/3bb8c6bfd4c441a1844723942dd2847c/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:31.175311 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f60d4-1dda-4456-8872-f7d5f5dc8a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0464d5a212274356a9b0698ac76cd96a, user_id=3bb8c6bfd4c441a1844723942dd2847c, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:31.178375 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f60d4-1dda-4456-8872-f7d5f5dc8a87 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:31.214331 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1053/2124] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:52:31 2022] PUT /identity/v3/projects/0464d5a212274356a9b0698ac76cd96a/users/3bb8c6bfd4c441a1844723942dd2847c/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:52:31.225338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54ab09-aca5-412d-b45e-d39806868bb1 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:31.225668 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54ab09-aca5-412d-b45e-d39806868bb1 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:31.226023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54ab09-aca5-412d-b45e-d39806868bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:31.256194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-6e54ab09-aca5-412d-b45e-d39806868bb1 None None] MFA Rules not processed for user `3bb8c6bfd4c441a1844723942dd2847c`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:31.257397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-6e54ab09-aca5-412d-b45e-d39806868bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:31.327924 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1072/2125] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:31.340590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f60d4-1dda-4456-8872-f7d5f5dc8a87 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:31.342464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ba7f60d4-1dda-4456-8872-f7d5f5dc8a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:31.405631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f60d4-1dda-4456-8872-f7d5f5dc8a87 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:31.410306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaceda5-b1ef-47cf-8dbd-8e0976a04d53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:31.410915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaceda5-b1ef-47cf-8dbd-8e0976a04d53 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:31.411195 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaceda5-b1ef-47cf-8dbd-8e0976a04d53 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:31.411550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaceda5-b1ef-47cf-8dbd-8e0976a04d53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:31.420275 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaceda5-b1ef-47cf-8dbd-8e0976a04d53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:31.421704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaceda5-b1ef-47cf-8dbd-8e0976a04d53 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:31.431223 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1054/2126] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:31.459634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54ab09-aca5-412d-b45e-d39806868bb1 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:31.536338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54ab09-aca5-412d-b45e-d39806868bb1 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:31.540875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:31.541509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:31.541790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:31.542092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] PATH_INFO: `/v3/users/3bb8c6bfd4c441a1844723942dd2847c` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:31.543222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb8c6bfd4c441a1844723942dd2847c)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:31.545209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:31.604365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:31.606228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb8c6bfd4c441a1844723942dd2847c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:31.615326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb8c6bfd4c441a1844723942dd2847c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:31.616328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb8c6bfd4c441a1844723942dd2847c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:31.617145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb8c6bfd4c441a1844723942dd2847c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:31.627128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb8c6bfd4c441a1844723942dd2847c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:31.650628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1073/2127] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:52:31 2022] DELETE /identity/v3/users/3bb8c6bfd4c441a1844723942dd2847c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:52:31.652324 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb40c8-bdf0-45a0-805f-3871d34a471a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:31.652786 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb40c8-bdf0-45a0-805f-3871d34a471a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:31.652870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb40c8-bdf0-45a0-805f-3871d34a471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:31.672130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-1beb40c8-bdf0-45a0-805f-3871d34a471a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:31.688976 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1beb40c8-bdf0-45a0-805f-3871d34a471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:31.778307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:31.820630 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1055/2128] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:31.829013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:31.831095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:31.937446 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62472695-53be-4b6e-ba46-b6684fc736d5 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:31.941920 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dfdda-7625-4f53-99ba-4a6cc27d7cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:31.942543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfdda-7625-4f53-99ba-4a6cc27d7cdc service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:31.942871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfdda-7625-4f53-99ba-4a6cc27d7cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:31.943163 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dfdda-7625-4f53-99ba-4a6cc27d7cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:31.966245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dfdda-7625-4f53-99ba-4a6cc27d7cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:31.967737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dfdda-7625-4f53-99ba-4a6cc27d7cdc service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:31.979110 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1074/2129] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:32.755813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb40c8-bdf0-45a0-805f-3871d34a471a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:32.758724 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1beb40c8-bdf0-45a0-805f-3871d34a471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:32.792665 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb40c8-bdf0-45a0-805f-3871d34a471a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:32.801398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:32.802629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:32.803249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:32.803773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] PATH_INFO: `/v3/projects/0464d5a212274356a9b0698ac76cd96a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:32.805208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0464d5a212274356a9b0698ac76cd96a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:32.807385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:32.905790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0464d5a212274356a9b0698ac76cd96a', 'request_id': 'req-abba3603-0120-4e2d-958b-c89e38ae60fa'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:32.915344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0464d5a212274356a9b0698ac76cd96a', 'request_id': 'req-abba3603-0120-4e2d-958b-c89e38ae60fa'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:32.939137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0464d5a212274356a9b0698ac76cd96a', 'request_id': 'req-abba3603-0120-4e2d-958b-c89e38ae60fa'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:32.959393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] The token cache is being invalidate because project 0464d5a212274356a9b0698ac76cd96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:52:32.959693 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:32.960383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:52:32.976658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1056/2130] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:52:32 2022] DELETE /identity/v3/projects/0464d5a212274356a9b0698ac76cd96a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:52:40.992849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b80a75-6761-46ae-9bd3-a4bdabba9ca6 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:40.993340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b80a75-6761-46ae-9bd3-a4bdabba9ca6 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:40.993438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b80a75-6761-46ae-9bd3-a4bdabba9ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:41.012112 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-58b80a75-6761-46ae-9bd3-a4bdabba9ca6 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:41.013295 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-58b80a75-6761-46ae-9bd3-a4bdabba9ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:41.069388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1075/2131] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 04:52:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:41.082427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:41.083841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:41.153420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba3603-0120-4e2d-958b-c89e38ae60fa admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:41.158717 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30946db8-fa86-4f87-b571-801eb9fd9c3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:41.159390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946db8-fa86-4f87-b571-801eb9fd9c3e service swift] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:41.159677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946db8-fa86-4f87-b571-801eb9fd9c3e service swift] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:41.159953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946db8-fa86-4f87-b571-801eb9fd9c3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:41.168505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30946db8-fa86-4f87-b571-801eb9fd9c3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:41.170102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30946db8-fa86-4f87-b571-801eb9fd9c3e service swift] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:41.178095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1057/2132] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:52:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:52:46.606334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aea02d-9daa-4379-b444-7ba696f7e5c2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:46.606927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aea02d-9daa-4379-b444-7ba696f7e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:46.606927 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aea02d-9daa-4379-b444-7ba696f7e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:46.625845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c0aea02d-9daa-4379-b444-7ba696f7e5c2 None None] MFA Rules not processed for user `94fe5ae1c52648fc9507216f4ab8d240`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:46.627015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c0aea02d-9daa-4379-b444-7ba696f7e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:46.681146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1076/2133] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:52:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:49.036807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55faf-f29c-4ee3-a2fc-8d8b2ac76cab None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:49.037385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55faf-f29c-4ee3-a2fc-8d8b2ac76cab None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:49.037385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55faf-f29c-4ee3-a2fc-8d8b2ac76cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:49.057830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-67b55faf-f29c-4ee3-a2fc-8d8b2ac76cab None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:49.059028 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-67b55faf-f29c-4ee3-a2fc-8d8b2ac76cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:49.117526 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1058/2134] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:52:49.148941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aea02d-9daa-4379-b444-7ba696f7e5c2 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:49.150946 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c0aea02d-9daa-4379-b444-7ba696f7e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:49.170763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:49.232691 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aea02d-9daa-4379-b444-7ba696f7e5c2 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:49.238457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f639e-8018-4881-bfd3-7f29763f12ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:49.239075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f639e-8018-4881-bfd3-7f29763f12ef service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:49.239402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f639e-8018-4881-bfd3-7f29763f12ef service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:49.239686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f639e-8018-4881-bfd3-7f29763f12ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:49.247998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f639e-8018-4881-bfd3-7f29763f12ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:49.249575 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f639e-8018-4881-bfd3-7f29763f12ef service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:49.260748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1077/2135] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:53.919100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55faf-f29c-4ee3-a2fc-8d8b2ac76cab None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:53.920726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-67b55faf-f29c-4ee3-a2fc-8d8b2ac76cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:53.927099 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:52:53.992642 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fafc61-35ff-48dc-8081-310c0e4bcb64 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:53.993864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fafc61-35ff-48dc-8081-310c0e4bcb64 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:53.994384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fafc61-35ff-48dc-8081-310c0e4bcb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:53.994505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55faf-f29c-4ee3-a2fc-8d8b2ac76cab None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:53.999731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac2bdc-be37-4715-876e-1e1919a569d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:54.000350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac2bdc-be37-4715-876e-1e1919a569d3 service placement] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:54.000636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac2bdc-be37-4715-876e-1e1919a569d3 service placement] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:54.000916 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac2bdc-be37-4715-876e-1e1919a569d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:54.002659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-39ac2bdc-be37-4715-876e-1e1919a569d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:54.014957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac2bdc-be37-4715-876e-1e1919a569d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:54.016633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac2bdc-be37-4715-876e-1e1919a569d3 service placement] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:54.017141 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d7fafc61-35ff-48dc-8081-310c0e4bcb64 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:54.018447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d7fafc61-35ff-48dc-8081-310c0e4bcb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:54.027322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1078/2136] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:52:54.027916 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1059/2137] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:54.048323 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fafc61-35ff-48dc-8081-310c0e4bcb64 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:54.065342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fafc61-35ff-48dc-8081-310c0e4bcb64 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:54.070866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af840-5795-417a-b734-483e37849c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:54.071640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af840-5795-417a-b734-483e37849c67 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:54.071925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af840-5795-417a-b734-483e37849c67 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:54.072202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4af840-5795-417a-b734-483e37849c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:54.080946 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4af840-5795-417a-b734-483e37849c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:54.082670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4af840-5795-417a-b734-483e37849c67 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:54.093321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1079/2138] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:52:57.231855 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158fd9-41ed-4529-94de-c56f4ba3c759 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:57.232353 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158fd9-41ed-4529-94de-c56f4ba3c759 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:57.232460 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158fd9-41ed-4529-94de-c56f4ba3c759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:57.254880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c8158fd9-41ed-4529-94de-c56f4ba3c759 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:52:57.257091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c8158fd9-41ed-4529-94de-c56f4ba3c759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:57.265417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1060/2139] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:52:57.292614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af840-5795-417a-b734-483e37849c67 service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:52:57.294071 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0a4af840-5795-417a-b734-483e37849c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:52:57.308993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4af840-5795-417a-b734-483e37849c67 service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:52:57.314486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2f21b-24a2-4890-9522-a3057c9f5f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:52:57.315091 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2f21b-24a2-4890-9522-a3057c9f5f7c service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:52:57.315407 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2f21b-24a2-4890-9522-a3057c9f5f7c service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:52:57.315683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2f21b-24a2-4890-9522-a3057c9f5f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:52:57.324718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2f21b-24a2-4890-9522-a3057c9f5f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:52:57.326201 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2f21b-24a2-4890-9522-a3057c9f5f7c service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:52:57.336558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1080/2140] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:53:00.339919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d3527-9734-4c94-94fc-c57666001d00 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:00.340405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d3527-9734-4c94-94fc-c57666001d00 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:00.340591 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d3527-9734-4c94-94fc-c57666001d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:00.361073 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-359d3527-9734-4c94-94fc-c57666001d00 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:53:00.362283 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-359d3527-9734-4c94-94fc-c57666001d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:53:00.370908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1061/2141] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:53:00.404498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2f21b-24a2-4890-9522-a3057c9f5f7c service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:53:00.415799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2f21b-24a2-4890-9522-a3057c9f5f7c service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:53:00.421365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7b89b-e55e-4ce2-9e3e-7b92a040e424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:53:00.421977 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7b89b-e55e-4ce2-9e3e-7b92a040e424 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:00.422259 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7b89b-e55e-4ce2-9e3e-7b92a040e424 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:00.422532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7b89b-e55e-4ce2-9e3e-7b92a040e424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:00.431303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7b89b-e55e-4ce2-9e3e-7b92a040e424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:53:00.432938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7b89b-e55e-4ce2-9e3e-7b92a040e424 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:53:00.442409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1081/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:53:05.546835 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c8ed2-28b2-4cc3-9c8d-78f67916c89f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:05.547350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c8ed2-28b2-4cc3-9c8d-78f67916c89f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:05.547447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c8ed2-28b2-4cc3-9c8d-78f67916c89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:05.567372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-9d2c8ed2-28b2-4cc3-9c8d-78f67916c89f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:53:05.569157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9d2c8ed2-28b2-4cc3-9c8d-78f67916c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:53:05.577117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1062/2143] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:53:05.628422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7b89b-e55e-4ce2-9e3e-7b92a040e424 service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:53:05.640331 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7b89b-e55e-4ce2-9e3e-7b92a040e424 service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:53:05.645627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5cbb7-e6de-4a42-9e8a-59869de2890f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:53:05.646207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5cbb7-e6de-4a42-9e8a-59869de2890f service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:05.646484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5cbb7-e6de-4a42-9e8a-59869de2890f service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:05.646756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5cbb7-e6de-4a42-9e8a-59869de2890f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:05.654552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5cbb7-e6de-4a42-9e8a-59869de2890f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:53:05.656173 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5cbb7-e6de-4a42-9e8a-59869de2890f service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:53:05.665269 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1082/2144] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:53:09.793742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b81e7-2855-4d0d-8aaa-14a028a85385 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:09.794228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b81e7-2855-4d0d-8aaa-14a028a85385 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:09.794327 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b81e7-2855-4d0d-8aaa-14a028a85385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:09.813507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c57b81e7-2855-4d0d-8aaa-14a028a85385 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:53:09.814694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c57b81e7-2855-4d0d-8aaa-14a028a85385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:53:09.822956 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1063/2145] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:53:09.869032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5cbb7-e6de-4a42-9e8a-59869de2890f service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:53:09.880072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5cbb7-e6de-4a42-9e8a-59869de2890f service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:53:09.886138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9661c-d91f-45b3-b841-1c50181e7262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:53:09.886717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9661c-d91f-45b3-b841-1c50181e7262 service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:09.886994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9661c-d91f-45b3-b841-1c50181e7262 service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:09.887267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9661c-d91f-45b3-b841-1c50181e7262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:09.895198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9661c-d91f-45b3-b841-1c50181e7262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:53:09.896829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9661c-d91f-45b3-b841-1c50181e7262 service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:53:09.906004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1083/2146] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:53:11.147499 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b81e7-2855-4d0d-8aaa-14a028a85385 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:53:11.148833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c57b81e7-2855-4d0d-8aaa-14a028a85385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:53:11.206608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b81e7-2855-4d0d-8aaa-14a028a85385 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:53:11.210819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f222312-2f68-4284-8bf1-2c763dbe9e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:53:11.211457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222312-2f68-4284-8bf1-2c763dbe9e95 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:11.211767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222312-2f68-4284-8bf1-2c763dbe9e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:11.212036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222312-2f68-4284-8bf1-2c763dbe9e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:11.213792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5f222312-2f68-4284-8bf1-2c763dbe9e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:53:11.275541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f222312-2f68-4284-8bf1-2c763dbe9e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:53:11.276957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f222312-2f68-4284-8bf1-2c763dbe9e95 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:53:11.286207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1064/2147] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:53:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:53:19.901901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=60 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:53:21.281977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:53:30.236876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ac06b-1937-416c-89bd-81b4a24271d7 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:30.237414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ac06b-1937-416c-89bd-81b4a24271d7 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:30.237414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ac06b-1937-416c-89bd-81b4a24271d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:30.257670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c21ac06b-1937-416c-89bd-81b4a24271d7 None None] MFA Rules not processed for user `b3afb5c7305d4162b32e57385d949af6`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:53:30.258876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c21ac06b-1937-416c-89bd-81b4a24271d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:53:30.313230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1084/2148] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:53:30.671159 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4100-dacc-4925-a8c5-cd916ec824e3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:30.671680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4100-dacc-4925-a8c5-cd916ec824e3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:30.671797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4100-dacc-4925-a8c5-cd916ec824e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:30.692348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-cabd4100-dacc-4925-a8c5-cd916ec824e3 None None] MFA Rules not processed for user `aa37eb12e65a4678a7153d1fdc37bdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:53:30.693567 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-cabd4100-dacc-4925-a8c5-cd916ec824e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:53:30.752893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1065/2149] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:53:40.306568 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=25 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:53:40.745995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=25 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:53:53.036366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e948a3-43ef-4cda-b7a4-d8755a2e0cea None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:53.036966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e948a3-43ef-4cda-b7a4-d8755a2e0cea None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:53.036966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e948a3-43ef-4cda-b7a4-d8755a2e0cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:53.056644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-f5e948a3-43ef-4cda-b7a4-d8755a2e0cea None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:53:53.057833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f5e948a3-43ef-4cda-b7a4-d8755a2e0cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:53:53.065731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1085/2150] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:53:53.087742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4100-dacc-4925-a8c5-cd916ec824e3 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:53:53.102663 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4100-dacc-4925-a8c5-cd916ec824e3 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:53:53.114702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c10cb1-8932-4f39-8626-f7df76bb63a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:53:53.114702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c10cb1-8932-4f39-8626-f7df76bb63a2 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:53:53.114702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c10cb1-8932-4f39-8626-f7df76bb63a2 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:53:53.114702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c10cb1-8932-4f39-8626-f7df76bb63a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:53:53.123934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c10cb1-8932-4f39-8626-f7df76bb63a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:53:53.125518 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c10cb1-8932-4f39-8626-f7df76bb63a2 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:53:53.136021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1066/2151] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:00.355412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a3f01-c7a9-4621-b86b-7873aa837182 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:00.355950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a3f01-c7a9-4621-b86b-7873aa837182 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:00.356122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a3f01-c7a9-4621-b86b-7873aa837182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:00.376781 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-728a3f01-c7a9-4621-b86b-7873aa837182 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:00.377990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-728a3f01-c7a9-4621-b86b-7873aa837182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:00.386956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1086/2152] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:54:00.422122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c10cb1-8932-4f39-8626-f7df76bb63a2 service nova] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:00.433520 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c10cb1-8932-4f39-8626-f7df76bb63a2 service nova] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:00.439102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b44b55-3dad-45be-b502-a19bde0d10b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:00.439750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44b55-3dad-45be-b502-a19bde0d10b2 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:00.440137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44b55-3dad-45be-b502-a19bde0d10b2 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:00.440422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44b55-3dad-45be-b502-a19bde0d10b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:00.450541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b44b55-3dad-45be-b502-a19bde0d10b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:00.452242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b44b55-3dad-45be-b502-a19bde0d10b2 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:00.462543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1067/2153] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:03.432625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355b2f0-d81f-483b-a5b5-971d1794cfc5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:03.433113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355b2f0-d81f-483b-a5b5-971d1794cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:03.433213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355b2f0-d81f-483b-a5b5-971d1794cfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:03.455428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-7355b2f0-d81f-483b-a5b5-971d1794cfc5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:03.457331 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-7355b2f0-d81f-483b-a5b5-971d1794cfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:03.466205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1087/2154] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:03.488513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b44b55-3dad-45be-b502-a19bde0d10b2 service nova] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:03.499772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b44b55-3dad-45be-b502-a19bde0d10b2 service nova] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:03.505696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bcb76-1d3d-4cf9-ab41-ef6c9efac79e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:03.506286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bcb76-1d3d-4cf9-ab41-ef6c9efac79e service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:03.506568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bcb76-1d3d-4cf9-ab41-ef6c9efac79e service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:03.506842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bcb76-1d3d-4cf9-ab41-ef6c9efac79e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:03.515035 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bcb76-1d3d-4cf9-ab41-ef6c9efac79e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:03.516639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bcb76-1d3d-4cf9-ab41-ef6c9efac79e service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:03.526239 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1068/2155] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:10.520491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9f8c-0a48-4988-9949-93788d2c0629 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:10.520972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9f8c-0a48-4988-9949-93788d2c0629 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:10.521086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9f8c-0a48-4988-9949-93788d2c0629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:10.540570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2aca9f8c-0a48-4988-9949-93788d2c0629 None None] MFA Rules not processed for user `beff795898ae42ae8ca96c3ccc00a31f`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:10.541768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2aca9f8c-0a48-4988-9949-93788d2c0629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:10.603807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1088/2156] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:10.748924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847cbf-948e-4bb2-9478-76272ae8bec6 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:10.749436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847cbf-948e-4bb2-9478-76272ae8bec6 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:10.749436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847cbf-948e-4bb2-9478-76272ae8bec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:10.769533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-fe847cbf-948e-4bb2-9478-76272ae8bec6 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:10.770730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fe847cbf-948e-4bb2-9478-76272ae8bec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:10.778880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1069/2157] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:10.807774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9f8c-0a48-4988-9949-93788d2c0629 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:10.820398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9f8c-0a48-4988-9949-93788d2c0629 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:10.826212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993a260-8862-4400-95ab-d5c0a52c005a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:10.826911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993a260-8862-4400-95ab-d5c0a52c005a service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:10.827317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993a260-8862-4400-95ab-d5c0a52c005a service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:10.827654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993a260-8862-4400-95ab-d5c0a52c005a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:10.839789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993a260-8862-4400-95ab-d5c0a52c005a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:10.841469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993a260-8862-4400-95ab-d5c0a52c005a service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:10.851184 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1089/2158] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:13.940653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fae02-d9b6-4ad2-adbd-927f0b0afee4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:13.943160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fae02-d9b6-4ad2-adbd-927f0b0afee4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:13.943612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fae02-d9b6-4ad2-adbd-927f0b0afee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:14.000911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-770fae02-d9b6-4ad2-adbd-927f0b0afee4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:14.004287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-770fae02-d9b6-4ad2-adbd-927f0b0afee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:14.023437 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1070/2159] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Oct 12 04:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:14.063611 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993a260-8862-4400-95ab-d5c0a52c005a service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:14.079250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993a260-8862-4400-95ab-d5c0a52c005a service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:14.088416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed96120-f152-4e29-afe9-dc5aa0f683fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:14.089233 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed96120-f152-4e29-afe9-dc5aa0f683fb service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:14.090122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed96120-f152-4e29-afe9-dc5aa0f683fb service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:14.091175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed96120-f152-4e29-afe9-dc5aa0f683fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:14.108914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed96120-f152-4e29-afe9-dc5aa0f683fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:14.112981 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed96120-f152-4e29-afe9-dc5aa0f683fb service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:14.138045 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1090/2160] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:14.458360 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fae02-d9b6-4ad2-adbd-927f0b0afee4 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:14.460102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-770fae02-d9b6-4ad2-adbd-927f0b0afee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:14.474130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fae02-d9b6-4ad2-adbd-927f0b0afee4 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:14.479170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:14.479861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:14.480237 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:14.481422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] PATH_INFO: `/v3/users/94fe5ae1c52648fc9507216f4ab8d240` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:14.482796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fe5ae1c52648fc9507216f4ab8d240)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:14.485782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:14.554225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fe5ae1c52648fc9507216f4ab8d240'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:14.565251 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fe5ae1c52648fc9507216f4ab8d240'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:14.566096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fe5ae1c52648fc9507216f4ab8d240'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:14.566913 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fe5ae1c52648fc9507216f4ab8d240'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:14.576050 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a14770f-fa59-4274-be66-9944498f9074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fe5ae1c52648fc9507216f4ab8d240'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:14.604607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1071/2161] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:54:14 2022] DELETE /identity/v3/users/94fe5ae1c52648fc9507216f4ab8d240 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:14.861125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed96120-f152-4e29-afe9-dc5aa0f683fb service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:14.875779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed96120-f152-4e29-afe9-dc5aa0f683fb service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:14.940126 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:14.941286 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:14.941573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:14.941854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] PATH_INFO: `/v3/projects/5268af0c10444c3d9342068a919121b9` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:14.943072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5268af0c10444c3d9342068a919121b9)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:14.945009 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:14.992099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5268af0c10444c3d9342068a919121b9', 'request_id': 'req-a82cbe14-c5bc-4790-ae87-ffe421652f5a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:14.999628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5268af0c10444c3d9342068a919121b9', 'request_id': 'req-a82cbe14-c5bc-4790-ae87-ffe421652f5a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:15.007075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5268af0c10444c3d9342068a919121b9', 'request_id': 'req-a82cbe14-c5bc-4790-ae87-ffe421652f5a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:15.008554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:15.023186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] The token cache is being invalidate because project 5268af0c10444c3d9342068a919121b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:54:15.023657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:15.024471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a82cbe14-c5bc-4790-ae87-ffe421652f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:15.026160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1091/2162] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:54:14 2022] DELETE /identity/v3/projects/5268af0c10444c3d9342068a919121b9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:15.031078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af995188-3982-4e6a-b708-b64a6d8da69d None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:15.031610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af995188-3982-4e6a-b708-b64a6d8da69d None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:15.031837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af995188-3982-4e6a-b708-b64a6d8da69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:15.064205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-af995188-3982-4e6a-b708-b64a6d8da69d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:15.066118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-af995188-3982-4e6a-b708-b64a6d8da69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:15.129537 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1072/2163] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:54:15.137517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff504ff3-a1e8-4924-9603-76bd05ed360b None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:15.138095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff504ff3-a1e8-4924-9603-76bd05ed360b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:15.138294 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff504ff3-a1e8-4924-9603-76bd05ed360b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:15.159214 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-ff504ff3-a1e8-4924-9603-76bd05ed360b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:15.160584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ff504ff3-a1e8-4924-9603-76bd05ed360b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:15.168923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1092/2164] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:15.173351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af995188-3982-4e6a-b708-b64a6d8da69d None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:15.183727 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af995188-3982-4e6a-b708-b64a6d8da69d None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:15.188498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf023b9-12d1-4f16-95a7-8acfb82fc122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:15.189124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf023b9-12d1-4f16-95a7-8acfb82fc122 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:15.189407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf023b9-12d1-4f16-95a7-8acfb82fc122 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:15.189682 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf023b9-12d1-4f16-95a7-8acfb82fc122 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:15.190959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf023b9-12d1-4f16-95a7-8acfb82fc122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:54:15.191305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf023b9-12d1-4f16-95a7-8acfb82fc122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:15.192941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf023b9-12d1-4f16-95a7-8acfb82fc122 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:15.206246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1073/2165] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:54:15.211776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff504ff3-a1e8-4924-9603-76bd05ed360b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:15.223138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff504ff3-a1e8-4924-9603-76bd05ed360b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:15.228407 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee68aac-d65c-4b25-8443-3f5d77398c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:15.229121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee68aac-d65c-4b25-8443-3f5d77398c15 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:15.229408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee68aac-d65c-4b25-8443-3f5d77398c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:15.229683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee68aac-d65c-4b25-8443-3f5d77398c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:15.230324 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee68aac-d65c-4b25-8443-3f5d77398c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:15.233302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee68aac-d65c-4b25-8443-3f5d77398c15 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:15.266951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1093/2166] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:54:15 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:15.268389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf023b9-12d1-4f16-95a7-8acfb82fc122 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:15.279543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf023b9-12d1-4f16-95a7-8acfb82fc122 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:15.283560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:15.340050 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbe0a9-759c-47b9-9137-93749cb6214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:15.340652 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe0a9-759c-47b9-9137-93749cb6214c admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:15.340931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe0a9-759c-47b9-9137-93749cb6214c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:15.341202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe0a9-759c-47b9-9137-93749cb6214c admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:15.342387 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbe0a9-759c-47b9-9137-93749cb6214c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:15.343772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbe0a9-759c-47b9-9137-93749cb6214c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:15.367908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1074/2167] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:54:15 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:15.372084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee68aac-d65c-4b25-8443-3f5d77398c15 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:15.382246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee68aac-d65c-4b25-8443-3f5d77398c15 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:15.386726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae58a0e-94c2-4df1-9c5b-5ba7ee71fee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:15.387347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae58a0e-94c2-4df1-9c5b-5ba7ee71fee4 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:15.387627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae58a0e-94c2-4df1-9c5b-5ba7ee71fee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:15.387896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae58a0e-94c2-4df1-9c5b-5ba7ee71fee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:15.388524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae58a0e-94c2-4df1-9c5b-5ba7ee71fee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:15.390131 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae58a0e-94c2-4df1-9c5b-5ba7ee71fee4 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:15.403306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1094/2168] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:15.404616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbe0a9-759c-47b9-9137-93749cb6214c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:15.415134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbe0a9-759c-47b9-9137-93749cb6214c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:15.420026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44426479-cb09-4322-a3f5-4740fed85ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:15.420661 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44426479-cb09-4322-a3f5-4740fed85ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:15.420942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44426479-cb09-4322-a3f5-4740fed85ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:15.421291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44426479-cb09-4322-a3f5-4740fed85ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:15.421851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44426479-cb09-4322-a3f5-4740fed85ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:15.423485 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44426479-cb09-4322-a3f5-4740fed85ce0 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:15.434807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1075/2169] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:15.439368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae58a0e-94c2-4df1-9c5b-5ba7ee71fee4 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:15.449660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae58a0e-94c2-4df1-9c5b-5ba7ee71fee4 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:15.454768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5b5ea-065a-4b97-9d92-8b16ac57bfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:15.455666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b5ea-065a-4b97-9d92-8b16ac57bfa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:15.456075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b5ea-065a-4b97-9d92-8b16ac57bfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:15.456420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b5ea-065a-4b97-9d92-8b16ac57bfa7 admin admin] PATH_INFO: `/v3/projects/1e31eca3c7c24d3db2785eb18e8e7ef5/users/987901acb1484ae4a4cd65b16eec6c78/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:15.472546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5b5ea-065a-4b97-9d92-8b16ac57bfa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e31eca3c7c24d3db2785eb18e8e7ef5, user_id=987901acb1484ae4a4cd65b16eec6c78, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:15.475247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5b5ea-065a-4b97-9d92-8b16ac57bfa7 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:15.488622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1095/2170] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:15 2022] PUT /identity/v3/projects/1e31eca3c7c24d3db2785eb18e8e7ef5/users/987901acb1484ae4a4cd65b16eec6c78/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:15.493713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e714c-ba0b-4155-87eb-aa287ba43550 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:15.494008 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e714c-ba0b-4155-87eb-aa287ba43550 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:15.494287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e714c-ba0b-4155-87eb-aa287ba43550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:15.512922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0b3e714c-ba0b-4155-87eb-aa287ba43550 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:15.514124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0b3e714c-ba0b-4155-87eb-aa287ba43550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:15.578942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1076/2171] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:15.589273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5b5ea-065a-4b97-9d92-8b16ac57bfa7 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:15.591004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9ff5b5ea-065a-4b97-9d92-8b16ac57bfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:15.649792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5b5ea-065a-4b97-9d92-8b16ac57bfa7 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:15.653638 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8aa62d-8422-49f7-82fe-c3699ff09b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:15.654356 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aa62d-8422-49f7-82fe-c3699ff09b9d service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:15.654640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aa62d-8422-49f7-82fe-c3699ff09b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:15.654914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aa62d-8422-49f7-82fe-c3699ff09b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:15.664901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8aa62d-8422-49f7-82fe-c3699ff09b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:15.666334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8aa62d-8422-49f7-82fe-c3699ff09b9d service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:15.676481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1096/2172] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:16.362059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644cd9e-6ce1-44f5-ba70-753c988f41e8 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:16.363938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644cd9e-6ce1-44f5-ba70-753c988f41e8 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:16.364355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644cd9e-6ce1-44f5-ba70-753c988f41e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:16.396413 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0644cd9e-6ce1-44f5-ba70-753c988f41e8 None None] MFA Rules not processed for user `987901acb1484ae4a4cd65b16eec6c78`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:16.397662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0644cd9e-6ce1-44f5-ba70-753c988f41e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:16.469728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1077/2173] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:16.474806 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8aa62d-8422-49f7-82fe-c3699ff09b9d service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:16.484573 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8aa62d-8422-49f7-82fe-c3699ff09b9d service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:16.489870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4a51f-d2f5-477d-9fa0-c105e2ef4405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:16.490556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4a51f-d2f5-477d-9fa0-c105e2ef4405 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:16.490906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4a51f-d2f5-477d-9fa0-c105e2ef4405 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:16.491251 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4a51f-d2f5-477d-9fa0-c105e2ef4405 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:16.491978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4a51f-d2f5-477d-9fa0-c105e2ef4405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:16.493955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4a51f-d2f5-477d-9fa0-c105e2ef4405 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:16.525728 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1097/2174] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:54:16 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:16.527041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644cd9e-6ce1-44f5-ba70-753c988f41e8 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:16.538374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644cd9e-6ce1-44f5-ba70-753c988f41e8 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:16.550952 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:16.599147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dbdc4-2588-4627-a462-96eaf654bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:16.599797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dbdc4-2588-4627-a462-96eaf654bce6 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:16.600085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dbdc4-2588-4627-a462-96eaf654bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:16.600365 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dbdc4-2588-4627-a462-96eaf654bce6 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:16.600998 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dbdc4-2588-4627-a462-96eaf654bce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:16.602942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dbdc4-2588-4627-a462-96eaf654bce6 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:16.623681 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1078/2175] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:54:16 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:16.627790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4a51f-d2f5-477d-9fa0-c105e2ef4405 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:16.637923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4a51f-d2f5-477d-9fa0-c105e2ef4405 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:16.642474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781513d-04da-499a-a9c5-afcbeb65f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:16.643074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781513d-04da-499a-a9c5-afcbeb65f180 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:16.643876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781513d-04da-499a-a9c5-afcbeb65f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:16.644159 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781513d-04da-499a-a9c5-afcbeb65f180 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:16.644792 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781513d-04da-499a-a9c5-afcbeb65f180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:16.646375 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781513d-04da-499a-a9c5-afcbeb65f180 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:16.656830 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1098/2176] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:16.661673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dbdc4-2588-4627-a462-96eaf654bce6 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:16.671479 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dbdc4-2588-4627-a462-96eaf654bce6 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:16.676116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac3fb1-ac4f-4ed2-8355-62a5f85b4925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:16.676761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac3fb1-ac4f-4ed2-8355-62a5f85b4925 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:16.677044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac3fb1-ac4f-4ed2-8355-62a5f85b4925 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:16.677319 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac3fb1-ac4f-4ed2-8355-62a5f85b4925 admin admin] PATH_INFO: `/v3/projects/f19307d9eefb486c9f5fa9f49b77cc77/users/ae1208646e184fddb9951cdd348a8e87/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:16.692108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac3fb1-ac4f-4ed2-8355-62a5f85b4925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19307d9eefb486c9f5fa9f49b77cc77, user_id=ae1208646e184fddb9951cdd348a8e87, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:16.694760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac3fb1-ac4f-4ed2-8355-62a5f85b4925 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:16.708764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1079/2177] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:16 2022] PUT /identity/v3/projects/f19307d9eefb486c9f5fa9f49b77cc77/users/ae1208646e184fddb9951cdd348a8e87/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:16.712783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781513d-04da-499a-a9c5-afcbeb65f180 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:16.723357 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781513d-04da-499a-a9c5-afcbeb65f180 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:16.774756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:16.782768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420ef98-16da-4da1-b0e9-43ee692d832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:16.783686 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420ef98-16da-4da1-b0e9-43ee692d832a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:16.784809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420ef98-16da-4da1-b0e9-43ee692d832a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:16.785171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420ef98-16da-4da1-b0e9-43ee692d832a admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:16.786095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420ef98-16da-4da1-b0e9-43ee692d832a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:16.787811 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420ef98-16da-4da1-b0e9-43ee692d832a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:16.797485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1099/2178] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:16.801894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac3fb1-ac4f-4ed2-8355-62a5f85b4925 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:16.812090 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac3fb1-ac4f-4ed2-8355-62a5f85b4925 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:16.816759 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c21f9-c976-4b1c-a131-2a415b6c708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:16.817413 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c21f9-c976-4b1c-a131-2a415b6c708b admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:16.817697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c21f9-c976-4b1c-a131-2a415b6c708b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:16.817981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c21f9-c976-4b1c-a131-2a415b6c708b admin admin] PATH_INFO: `/v3/projects/f19307d9eefb486c9f5fa9f49b77cc77/users/ae1208646e184fddb9951cdd348a8e87/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:16.819945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c21f9-c976-4b1c-a131-2a415b6c708b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19307d9eefb486c9f5fa9f49b77cc77, user_id=ae1208646e184fddb9951cdd348a8e87, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:16.822576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c21f9-c976-4b1c-a131-2a415b6c708b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:16.833512 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1080/2179] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:16 2022] PUT /identity/v3/projects/f19307d9eefb486c9f5fa9f49b77cc77/users/ae1208646e184fddb9951cdd348a8e87/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:17.506846 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d0b9-0c82-4f2b-bf97-0ee0f949008c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:17.507433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d0b9-0c82-4f2b-bf97-0ee0f949008c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:17.507544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d0b9-0c82-4f2b-bf97-0ee0f949008c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:17.536674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-3ba0d0b9-0c82-4f2b-bf97-0ee0f949008c None None] MFA Rules not processed for user `ae1208646e184fddb9951cdd348a8e87`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:17.537879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3ba0d0b9-0c82-4f2b-bf97-0ee0f949008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:17.622363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1100/2180] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:17 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:18.396113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c21f9-c976-4b1c-a131-2a415b6c708b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:18.398488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-843c21f9-c976-4b1c-a131-2a415b6c708b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:18.470835 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c21f9-c976-4b1c-a131-2a415b6c708b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:18.482517 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d33547-de19-4ba6-b7cf-7db353c62c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:18.483323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d33547-de19-4ba6-b7cf-7db353c62c60 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:18.483643 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d33547-de19-4ba6-b7cf-7db353c62c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:18.483901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d33547-de19-4ba6-b7cf-7db353c62c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:18.486091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e8d33547-de19-4ba6-b7cf-7db353c62c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:18.546737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0d0b9-0c82-4f2b-bf97-0ee0f949008c None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:18.563838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0d0b9-0c82-4f2b-bf97-0ee0f949008c None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:18.567075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d33547-de19-4ba6-b7cf-7db353c62c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:18.568804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d33547-de19-4ba6-b7cf-7db353c62c60 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:18.569198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff684a9-8ab1-4ef2-a326-822b6570647c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:18.569987 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff684a9-8ab1-4ef2-a326-822b6570647c service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:18.570273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff684a9-8ab1-4ef2-a326-822b6570647c service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:18.570542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff684a9-8ab1-4ef2-a326-822b6570647c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:18.572316 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3ff684a9-8ab1-4ef2-a326-822b6570647c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:18.587098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff684a9-8ab1-4ef2-a326-822b6570647c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:18.588405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1081/2181] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:54:18.588964 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff684a9-8ab1-4ef2-a326-822b6570647c service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:18.600460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1101/2182] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:18.698200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d33547-de19-4ba6-b7cf-7db353c62c60 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:18.711371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:18.769443 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d33547-de19-4ba6-b7cf-7db353c62c60 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:18.774355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:18.775010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:18.775310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:18.775602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] PATH_INFO: `/v3/users/987901acb1484ae4a4cd65b16eec6c78` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:18.776767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=987901acb1484ae4a4cd65b16eec6c78)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:18.778688 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:18.834476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987901acb1484ae4a4cd65b16eec6c78'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:18.841190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987901acb1484ae4a4cd65b16eec6c78'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:18.841839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987901acb1484ae4a4cd65b16eec6c78'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:18.842441 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987901acb1484ae4a4cd65b16eec6c78'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:18.849433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987901acb1484ae4a4cd65b16eec6c78'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:18.867665 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1082/2183] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:54:18 2022] DELETE /identity/v3/users/987901acb1484ae4a4cd65b16eec6c78 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:19.035013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff684a9-8ab1-4ef2-a326-822b6570647c service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:19.049547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff684a9-8ab1-4ef2-a326-822b6570647c service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:19.106673 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:19.107322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:19.107606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:19.107882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] PATH_INFO: `/v3/projects/1e31eca3c7c24d3db2785eb18e8e7ef5` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:19.108973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e31eca3c7c24d3db2785eb18e8e7ef5)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:19.110862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:19.156353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e31eca3c7c24d3db2785eb18e8e7ef5', 'request_id': 'req-e0c91fac-45f0-4747-af99-70cdfa11a64a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.163904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e31eca3c7c24d3db2785eb18e8e7ef5', 'request_id': 'req-e0c91fac-45f0-4747-af99-70cdfa11a64a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.170220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e31eca3c7c24d3db2785eb18e8e7ef5', 'request_id': 'req-e0c91fac-45f0-4747-af99-70cdfa11a64a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.174056 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:19.183092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] The token cache is being invalidate because project 1e31eca3c7c24d3db2785eb18e8e7ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:54:19.183586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.184203 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.185651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1102/2184] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:54:19 2022] DELETE /identity/v3/projects/1e31eca3c7c24d3db2785eb18e8e7ef5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:19.189745 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:19.191689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:19.204930 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5a18-6f01-4f0d-86cf-f33a5e982b6c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:19.260270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:19.260904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:19.261195 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:19.261476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] PATH_INFO: `/v3/users/ae1208646e184fddb9951cdd348a8e87` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:19.262615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1208646e184fddb9951cdd348a8e87)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:19.264559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:19.297526 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:19.312610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1208646e184fddb9951cdd348a8e87'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.320108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1208646e184fddb9951cdd348a8e87'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.320773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1208646e184fddb9951cdd348a8e87'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.321378 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1208646e184fddb9951cdd348a8e87'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.328769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e0167d3b-fde6-4308-8925-870cc55f3782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1208646e184fddb9951cdd348a8e87'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.346473 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1083/2185] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:54:19 2022] DELETE /identity/v3/users/ae1208646e184fddb9951cdd348a8e87 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:19.515476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:19.516981 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:19.531323 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91fac-45f0-4747-af99-70cdfa11a64a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:19.590489 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:19.591127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:19.591445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:19.591727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] PATH_INFO: `/v3/projects/f19307d9eefb486c9f5fa9f49b77cc77` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:19.592849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19307d9eefb486c9f5fa9f49b77cc77)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:19.594761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:19.640622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19307d9eefb486c9f5fa9f49b77cc77', 'request_id': 'req-40f3206a-1f29-428a-8539-d28ef160d375'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.647518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19307d9eefb486c9f5fa9f49b77cc77', 'request_id': 'req-40f3206a-1f29-428a-8539-d28ef160d375'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.653776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19307d9eefb486c9f5fa9f49b77cc77', 'request_id': 'req-40f3206a-1f29-428a-8539-d28ef160d375'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.664104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] The token cache is being invalidate because project f19307d9eefb486c9f5fa9f49b77cc77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:54:19.664390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.665012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-40f3206a-1f29-428a-8539-d28ef160d375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:19.666476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1103/2186] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:54:19 2022] DELETE /identity/v3/projects/f19307d9eefb486c9f5fa9f49b77cc77 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:19.671342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f39f9-db12-4d59-8f9e-cbed51ad46b3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:19.671808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f39f9-db12-4d59-8f9e-cbed51ad46b3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:19.671914 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f39f9-db12-4d59-8f9e-cbed51ad46b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:19.693037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-279f39f9-db12-4d59-8f9e-cbed51ad46b3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:19.694214 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-279f39f9-db12-4d59-8f9e-cbed51ad46b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:19.750758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1084/2187] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:19.758923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfb520-01d0-4bc1-a01b-e174c6293da1 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:19.759212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfb520-01d0-4bc1-a01b-e174c6293da1 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:19.759517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfb520-01d0-4bc1-a01b-e174c6293da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:19.779670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-05dfb520-01d0-4bc1-a01b-e174c6293da1 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:19.780929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-05dfb520-01d0-4bc1-a01b-e174c6293da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:19.788842 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1104/2188] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:19.793183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f39f9-db12-4d59-8f9e-cbed51ad46b3 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:19.803684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f39f9-db12-4d59-8f9e-cbed51ad46b3 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:19.809068 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec03f9-7ee4-4725-957e-c4ed367bf249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:19.809820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec03f9-7ee4-4725-957e-c4ed367bf249 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:19.810108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec03f9-7ee4-4725-957e-c4ed367bf249 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:19.810854 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec03f9-7ee4-4725-957e-c4ed367bf249 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:19.811167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec03f9-7ee4-4725-957e-c4ed367bf249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:54:19.811509 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec03f9-7ee4-4725-957e-c4ed367bf249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:19.813105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec03f9-7ee4-4725-957e-c4ed367bf249 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:19.826146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1085/2189] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 04:54:19.831972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfb520-01d0-4bc1-a01b-e174c6293da1 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:19.841885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfb520-01d0-4bc1-a01b-e174c6293da1 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:19.846725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf684d-a7c9-4571-84c1-6f75b8bf0f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:19.847991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf684d-a7c9-4571-84c1-6f75b8bf0f01 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:19.847991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf684d-a7c9-4571-84c1-6f75b8bf0f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:19.848237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf684d-a7c9-4571-84c1-6f75b8bf0f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:19.848933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf684d-a7c9-4571-84c1-6f75b8bf0f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:19.851128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf684d-a7c9-4571-84c1-6f75b8bf0f01 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:19.883016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1105/2190] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:54:19 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:19.887321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec03f9-7ee4-4725-957e-c4ed367bf249 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:19.897472 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec03f9-7ee4-4725-957e-c4ed367bf249 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:19.955546 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d10047-b411-4bc9-b224-3e6875668899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:19.956165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d10047-b411-4bc9-b224-3e6875668899 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:19.956445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d10047-b411-4bc9-b224-3e6875668899 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:19.956719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d10047-b411-4bc9-b224-3e6875668899 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:19.957359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d10047-b411-4bc9-b224-3e6875668899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:19.959318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d10047-b411-4bc9-b224-3e6875668899 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:19.982742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1086/2191] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:54:19 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:54:19.987937 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf684d-a7c9-4571-84c1-6f75b8bf0f01 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:19.998341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf684d-a7c9-4571-84c1-6f75b8bf0f01 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.003313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d1e02-acde-4ed3-a7d8-0c3d908f680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.003953 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1e02-acde-4ed3-a7d8-0c3d908f680f admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.004238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1e02-acde-4ed3-a7d8-0c3d908f680f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.004513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1e02-acde-4ed3-a7d8-0c3d908f680f admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.005150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d1e02-acde-4ed3-a7d8-0c3d908f680f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.006750 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d1e02-acde-4ed3-a7d8-0c3d908f680f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:20.020578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1106/2192] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:20.022266 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d10047-b411-4bc9-b224-3e6875668899 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:20.035407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d10047-b411-4bc9-b224-3e6875668899 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.041725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f3da0-3fac-4d0d-90e5-52729be659f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.041725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3da0-3fac-4d0d-90e5-52729be659f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.041725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3da0-3fac-4d0d-90e5-52729be659f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.041725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3da0-3fac-4d0d-90e5-52729be659f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.042250 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f3da0-3fac-4d0d-90e5-52729be659f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.043968 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f3da0-3fac-4d0d-90e5-52729be659f5 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:20.056352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1087/2193] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:20.060244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d1e02-acde-4ed3-a7d8-0c3d908f680f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:20.070584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d1e02-acde-4ed3-a7d8-0c3d908f680f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.075127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48d86-587a-4d66-b1e9-66eebc41fe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.075807 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48d86-587a-4d66-b1e9-66eebc41fe10 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.076084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48d86-587a-4d66-b1e9-66eebc41fe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.076358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48d86-587a-4d66-b1e9-66eebc41fe10 admin admin] PATH_INFO: `/v3/projects/280bfe67829840dead7698ec909e57a0/users/68a8d6706de94a7bbb45fac0cfc870fc/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.090798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca48d86-587a-4d66-b1e9-66eebc41fe10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280bfe67829840dead7698ec909e57a0, user_id=68a8d6706de94a7bbb45fac0cfc870fc, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.093538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca48d86-587a-4d66-b1e9-66eebc41fe10 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:20.106600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1107/2194] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:20 2022] PUT /identity/v3/projects/280bfe67829840dead7698ec909e57a0/users/68a8d6706de94a7bbb45fac0cfc870fc/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:54:20.117423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5761975-e3b1-48bf-853d-e00581f0aac6 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.117744 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5761975-e3b1-48bf-853d-e00581f0aac6 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.118057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5761975-e3b1-48bf-853d-e00581f0aac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.142461 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:20.145564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b5761975-e3b1-48bf-853d-e00581f0aac6 None None] MFA Rules not processed for user `68a8d6706de94a7bbb45fac0cfc870fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:20.147307 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b5761975-e3b1-48bf-853d-e00581f0aac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:20.214829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1088/2195] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:20.219358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48d86-587a-4d66-b1e9-66eebc41fe10 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:20.241388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:20.293265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca48d86-587a-4d66-b1e9-66eebc41fe10 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.298084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4f331-6cf5-4116-a88f-8b7139bfc3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.298693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4f331-6cf5-4116-a88f-8b7139bfc3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.298974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4f331-6cf5-4116-a88f-8b7139bfc3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.299247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4f331-6cf5-4116-a88f-8b7139bfc3a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.300461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4f331-6cf5-4116-a88f-8b7139bfc3a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.302483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4f331-6cf5-4116-a88f-8b7139bfc3a4 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:20.329965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1108/2196] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:54:20 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:20.334534 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5761975-e3b1-48bf-853d-e00581f0aac6 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:20.345496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5761975-e3b1-48bf-853d-e00581f0aac6 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.406406 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147f569-6993-4955-9ff9-d3750a4444b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.407035 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147f569-6993-4955-9ff9-d3750a4444b8 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.407341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147f569-6993-4955-9ff9-d3750a4444b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.407623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147f569-6993-4955-9ff9-d3750a4444b8 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.408271 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147f569-6993-4955-9ff9-d3750a4444b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.410752 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147f569-6993-4955-9ff9-d3750a4444b8 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:20.435617 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1089/2197] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:54:20 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:20.436962 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4f331-6cf5-4116-a88f-8b7139bfc3a4 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:20.447136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4f331-6cf5-4116-a88f-8b7139bfc3a4 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.451955 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f10e0a-4e49-4124-995c-d95b682d5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.452652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f10e0a-4e49-4124-995c-d95b682d5e29 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.452993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f10e0a-4e49-4124-995c-d95b682d5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.453332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f10e0a-4e49-4124-995c-d95b682d5e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.454305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f10e0a-4e49-4124-995c-d95b682d5e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.456495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f10e0a-4e49-4124-995c-d95b682d5e29 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:20.468914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1109/2198] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:20.473948 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147f569-6993-4955-9ff9-d3750a4444b8 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:20.484137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147f569-6993-4955-9ff9-d3750a4444b8 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.488733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4f30d-16f0-4cea-afe2-0ccb15cf00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.489383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4f30d-16f0-4cea-afe2-0ccb15cf00cd admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.489666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4f30d-16f0-4cea-afe2-0ccb15cf00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.489943 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4f30d-16f0-4cea-afe2-0ccb15cf00cd admin admin] PATH_INFO: `/v3/projects/0295d86d1c8e4549a67a4f17b58ea976/users/9f4ae6d5d0354384b7ccdf7af9274169/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.504412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4f30d-16f0-4cea-afe2-0ccb15cf00cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0295d86d1c8e4549a67a4f17b58ea976, user_id=9f4ae6d5d0354384b7ccdf7af9274169, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.507051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4f30d-16f0-4cea-afe2-0ccb15cf00cd admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:20.520066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1090/2199] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:20 2022] PUT /identity/v3/projects/0295d86d1c8e4549a67a4f17b58ea976/users/9f4ae6d5d0354384b7ccdf7af9274169/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:54:20.523990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f10e0a-4e49-4124-995c-d95b682d5e29 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:20.533797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f10e0a-4e49-4124-995c-d95b682d5e29 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.591168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f02e3-ef92-419b-af2d-220866450301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.591815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f02e3-ef92-419b-af2d-220866450301 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.592098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f02e3-ef92-419b-af2d-220866450301 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.592376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f02e3-ef92-419b-af2d-220866450301 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.593012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f02e3-ef92-419b-af2d-220866450301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.594591 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f02e3-ef92-419b-af2d-220866450301 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:20.604817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1110/2200] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:20.608881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4f30d-16f0-4cea-afe2-0ccb15cf00cd admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:20.618984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4f30d-16f0-4cea-afe2-0ccb15cf00cd admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.623606 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecef29d-d11a-44f9-8b99-1d05ebcd0d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.624256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecef29d-d11a-44f9-8b99-1d05ebcd0d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.624535 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecef29d-d11a-44f9-8b99-1d05ebcd0d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.624808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecef29d-d11a-44f9-8b99-1d05ebcd0d9f admin admin] PATH_INFO: `/v3/projects/0295d86d1c8e4549a67a4f17b58ea976/users/9f4ae6d5d0354384b7ccdf7af9274169/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.626705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecef29d-d11a-44f9-8b99-1d05ebcd0d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0295d86d1c8e4549a67a4f17b58ea976, user_id=9f4ae6d5d0354384b7ccdf7af9274169, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.629344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecef29d-d11a-44f9-8b99-1d05ebcd0d9f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:20.639132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1091/2201] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:20 2022] PUT /identity/v3/projects/0295d86d1c8e4549a67a4f17b58ea976/users/9f4ae6d5d0354384b7ccdf7af9274169/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:54:20.650674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbdee7-a292-45f5-ba2a-31f9a35297ad None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.650957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbdee7-a292-45f5-ba2a-31f9a35297ad None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.651256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbdee7-a292-45f5-ba2a-31f9a35297ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.680223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-f0dbdee7-a292-45f5-ba2a-31f9a35297ad None None] MFA Rules not processed for user `9f4ae6d5d0354384b7ccdf7af9274169`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:20.681419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f0dbdee7-a292-45f5-ba2a-31f9a35297ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:20.747383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1111/2202] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:20.759902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecef29d-d11a-44f9-8b99-1d05ebcd0d9f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:20.761619 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1ecef29d-d11a-44f9-8b99-1d05ebcd0d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:20.819608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecef29d-d11a-44f9-8b99-1d05ebcd0d9f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.823308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f7874-1e3d-4c5c-a5d1-e73e86108c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.823909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f7874-1e3d-4c5c-a5d1-e73e86108c1d service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.824198 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f7874-1e3d-4c5c-a5d1-e73e86108c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.824478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f7874-1e3d-4c5c-a5d1-e73e86108c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.834871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f7874-1e3d-4c5c-a5d1-e73e86108c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.836498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f7874-1e3d-4c5c-a5d1-e73e86108c1d service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:20.840479 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:20.849257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1092/2203] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:20.914774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbdee7-a292-45f5-ba2a-31f9a35297ad None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:20.932916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:20.979182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbdee7-a292-45f5-ba2a-31f9a35297ad None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:20.983943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:20.984572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:20.984851 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:20.985153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] PATH_INFO: `/v3/users/68a8d6706de94a7bbb45fac0cfc870fc` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:20.986266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a8d6706de94a7bbb45fac0cfc870fc)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:20.988781 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:21.033136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a8d6706de94a7bbb45fac0cfc870fc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.040457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a8d6706de94a7bbb45fac0cfc870fc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.041106 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a8d6706de94a7bbb45fac0cfc870fc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.041705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a8d6706de94a7bbb45fac0cfc870fc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.049161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a8d6706de94a7bbb45fac0cfc870fc'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.077860 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1112/2204] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:54:20 2022] DELETE /identity/v3/users/68a8d6706de94a7bbb45fac0cfc870fc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:21.079371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ea22-8f64-4f12-852f-ca0eab113375 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:21.079770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ea22-8f64-4f12-852f-ca0eab113375 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:21.080119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616ea22-8f64-4f12-852f-ca0eab113375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:21.105529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-6616ea22-8f64-4f12-852f-ca0eab113375 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:21.108722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6616ea22-8f64-4f12-852f-ca0eab113375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:21.174063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1093/2205] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:54:21.184006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:21.185645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:21.243420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f351-70cc-4f55-9ffc-c5c1bd82f7e9 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:21.247026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1b32b-47f1-49f9-966f-3460c51de2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:21.247675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1b32b-47f1-49f9-966f-3460c51de2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:21.247957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1b32b-47f1-49f9-966f-3460c51de2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:21.248233 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1b32b-47f1-49f9-966f-3460c51de2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:21.257454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1b32b-47f1-49f9-966f-3460c51de2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:21.258889 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1b32b-47f1-49f9-966f-3460c51de2a8 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:21.268872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1113/2206] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:21.541359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616ea22-8f64-4f12-852f-ca0eab113375 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:21.542799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6616ea22-8f64-4f12-852f-ca0eab113375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:21.558160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616ea22-8f64-4f12-852f-ca0eab113375 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:21.562455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:21.563111 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:21.563431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:21.563708 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] PATH_INFO: `/v3/projects/280bfe67829840dead7698ec909e57a0` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:21.565649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=280bfe67829840dead7698ec909e57a0)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:21.567937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:21.620504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280bfe67829840dead7698ec909e57a0', 'request_id': 'req-f0f4cabc-4c24-410b-a7af-3f375ea03258'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.626573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280bfe67829840dead7698ec909e57a0', 'request_id': 'req-f0f4cabc-4c24-410b-a7af-3f375ea03258'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.634096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280bfe67829840dead7698ec909e57a0', 'request_id': 'req-f0f4cabc-4c24-410b-a7af-3f375ea03258'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.644843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] The token cache is being invalidate because project 280bfe67829840dead7698ec909e57a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:54:21.645140 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.645776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.647361 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1094/2207] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:54:21 2022] DELETE /identity/v3/projects/280bfe67829840dead7698ec909e57a0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:21.651249 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1b32b-47f1-49f9-966f-3460c51de2a8 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:21.661077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1b32b-47f1-49f9-966f-3460c51de2a8 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:21.693744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:21.718870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:21.719537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:21.719822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:21.720094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] PATH_INFO: `/v3/users/9f4ae6d5d0354384b7ccdf7af9274169` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:21.721207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4ae6d5d0354384b7ccdf7af9274169)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:21.723090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:21.767462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4ae6d5d0354384b7ccdf7af9274169'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.775110 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4ae6d5d0354384b7ccdf7af9274169'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.775867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4ae6d5d0354384b7ccdf7af9274169'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.776500 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4ae6d5d0354384b7ccdf7af9274169'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.784476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-168895bf-4391-4841-9617-85c370da6528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4ae6d5d0354384b7ccdf7af9274169'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:21.802344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1114/2208] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:54:21 2022] DELETE /identity/v3/users/9f4ae6d5d0354384b7ccdf7af9274169 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:22.062380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:22.063932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:22.077780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4cabc-4c24-410b-a7af-3f375ea03258 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:22.134872 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:22.135539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.135827 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.136107 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] PATH_INFO: `/v3/projects/0295d86d1c8e4549a67a4f17b58ea976` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.137260 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0295d86d1c8e4549a67a4f17b58ea976)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:22.139158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:22.163241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:22.186510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0295d86d1c8e4549a67a4f17b58ea976', 'request_id': 'req-ebb76b29-a0e7-460f-ab4e-71356f2702e2'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:22.192704 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0295d86d1c8e4549a67a4f17b58ea976', 'request_id': 'req-ebb76b29-a0e7-460f-ab4e-71356f2702e2'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:22.199121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0295d86d1c8e4549a67a4f17b58ea976', 'request_id': 'req-ebb76b29-a0e7-460f-ab4e-71356f2702e2'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:22.209873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] The token cache is being invalidate because project 0295d86d1c8e4549a67a4f17b58ea976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:54:22.210165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:22.210828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ebb76b29-a0e7-460f-ab4e-71356f2702e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:22.212322 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1095/2209] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:54:22 2022] DELETE /identity/v3/projects/0295d86d1c8e4549a67a4f17b58ea976 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:22.217165 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44902d0-1687-49d7-bf2e-2df0ec4aa87a None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.217448 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44902d0-1687-49d7-bf2e-2df0ec4aa87a None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.217733 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44902d0-1687-49d7-bf2e-2df0ec4aa87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.238440 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c44902d0-1687-49d7-bf2e-2df0ec4aa87a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:22.239752 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c44902d0-1687-49d7-bf2e-2df0ec4aa87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:22.300639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1115/2210] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:22.308472 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3870a0-fd06-46ba-9fb5-852c6121c6f4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.308869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3870a0-fd06-46ba-9fb5-852c6121c6f4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.309257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3870a0-fd06-46ba-9fb5-852c6121c6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.331000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-8f3870a0-fd06-46ba-9fb5-852c6121c6f4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:22.332588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8f3870a0-fd06-46ba-9fb5-852c6121c6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:22.341770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1096/2211] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:54:22.345871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44902d0-1687-49d7-bf2e-2df0ec4aa87a None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:22.358297 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44902d0-1687-49d7-bf2e-2df0ec4aa87a None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:22.368091 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ac656-6824-409a-934e-1c0ad94dad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:22.369001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ac656-6824-409a-934e-1c0ad94dad03 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.369441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ac656-6824-409a-934e-1c0ad94dad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.369905 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ac656-6824-409a-934e-1c0ad94dad03 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.370795 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ac656-6824-409a-934e-1c0ad94dad03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:54:22.371266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ac656-6824-409a-934e-1c0ad94dad03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:22.373293 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ac656-6824-409a-934e-1c0ad94dad03 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:22.388459 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1116/2212] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:54:22.392439 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3870a0-fd06-46ba-9fb5-852c6121c6f4 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:22.402502 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3870a0-fd06-46ba-9fb5-852c6121c6f4 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:22.407500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e2dbc-17f2-4efd-9127-461514acc4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:22.408123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e2dbc-17f2-4efd-9127-461514acc4aa admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.408403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e2dbc-17f2-4efd-9127-461514acc4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.409192 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e2dbc-17f2-4efd-9127-461514acc4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.409855 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e2dbc-17f2-4efd-9127-461514acc4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:22.411814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e2dbc-17f2-4efd-9127-461514acc4aa admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:22.449351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1097/2213] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:54:22 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:22.450523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ac656-6824-409a-934e-1c0ad94dad03 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:22.461353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ac656-6824-409a-934e-1c0ad94dad03 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:22.522092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:22.539395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cc841-7dae-48ed-88e9-d171c31a4f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:22.540034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cc841-7dae-48ed-88e9-d171c31a4f3e admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.540315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cc841-7dae-48ed-88e9-d171c31a4f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.540588 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cc841-7dae-48ed-88e9-d171c31a4f3e admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.541214 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cc841-7dae-48ed-88e9-d171c31a4f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:22.543125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cc841-7dae-48ed-88e9-d171c31a4f3e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:22.568819 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1117/2214] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:54:22 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:22.573128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e2dbc-17f2-4efd-9127-461514acc4aa admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:22.591174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e2dbc-17f2-4efd-9127-461514acc4aa admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:22.597207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6980-4e39-48ca-9164-e0f1bb3a2f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:22.597848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6980-4e39-48ca-9164-e0f1bb3a2f4e admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.598136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6980-4e39-48ca-9164-e0f1bb3a2f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.598412 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6980-4e39-48ca-9164-e0f1bb3a2f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.599160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e6980-4e39-48ca-9164-e0f1bb3a2f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:22.603329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e6980-4e39-48ca-9164-e0f1bb3a2f4e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:22.613889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1098/2215] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:22.617898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cc841-7dae-48ed-88e9-d171c31a4f3e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:22.627980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cc841-7dae-48ed-88e9-d171c31a4f3e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:22.632679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb0edb-e0cb-458b-bd71-096eeee1f7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:22.633272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0edb-e0cb-458b-bd71-096eeee1f7cc admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.633554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0edb-e0cb-458b-bd71-096eeee1f7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.633831 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0edb-e0cb-458b-bd71-096eeee1f7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.634476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb0edb-e0cb-458b-bd71-096eeee1f7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:22.636110 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb0edb-e0cb-458b-bd71-096eeee1f7cc admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:22.647208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1118/2216] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:54:22.651054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6980-4e39-48ca-9164-e0f1bb3a2f4e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:22.661298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6980-4e39-48ca-9164-e0f1bb3a2f4e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:22.665972 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8e4a6-fb10-4657-a3e8-3b81110f9299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:22.666612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8e4a6-fb10-4657-a3e8-3b81110f9299 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.666893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8e4a6-fb10-4657-a3e8-3b81110f9299 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.667167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8e4a6-fb10-4657-a3e8-3b81110f9299 admin admin] PATH_INFO: `/v3/projects/34f9f43c98a444999312cf72ad050914/users/62ea529a83144054804bb302356166e7/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.681561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8e4a6-fb10-4657-a3e8-3b81110f9299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f9f43c98a444999312cf72ad050914, user_id=62ea529a83144054804bb302356166e7, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:22.684165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8e4a6-fb10-4657-a3e8-3b81110f9299 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:22.696417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1099/2217] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:22 2022] PUT /identity/v3/projects/34f9f43c98a444999312cf72ad050914/users/62ea529a83144054804bb302356166e7/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:54:22.708629 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5035ba5-8b41-47e9-89eb-100791495224 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.709102 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5035ba5-8b41-47e9-89eb-100791495224 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.709222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5035ba5-8b41-47e9-89eb-100791495224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.736867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a5035ba5-8b41-47e9-89eb-100791495224 None None] MFA Rules not processed for user `62ea529a83144054804bb302356166e7`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:22.738061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a5035ba5-8b41-47e9-89eb-100791495224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:22.801018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1119/2218] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:22.811470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8e4a6-fb10-4657-a3e8-3b81110f9299 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:22.813161 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2bc8e4a6-fb10-4657-a3e8-3b81110f9299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:22.869692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8e4a6-fb10-4657-a3e8-3b81110f9299 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:22.873415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbf615-c6dd-4dcd-854e-bfb56b08ab85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:22.874024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbf615-c6dd-4dcd-854e-bfb56b08ab85 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:22.874306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbf615-c6dd-4dcd-854e-bfb56b08ab85 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:22.874584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbf615-c6dd-4dcd-854e-bfb56b08ab85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:22.882775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbf615-c6dd-4dcd-854e-bfb56b08ab85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:22.884241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbf615-c6dd-4dcd-854e-bfb56b08ab85 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:22.892833 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1100/2219] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:25.897047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5035ba5-8b41-47e9-89eb-100791495224 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:25.959133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5035ba5-8b41-47e9-89eb-100791495224 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:25.963675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:25.964299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:25.964579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:25.964852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] PATH_INFO: `/v3/users/62ea529a83144054804bb302356166e7` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:25.965949 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ea529a83144054804bb302356166e7)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:25.967906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:26.019194 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ea529a83144054804bb302356166e7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:26.025025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:26.027260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ea529a83144054804bb302356166e7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:26.028131 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ea529a83144054804bb302356166e7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:26.029306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ea529a83144054804bb302356166e7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:26.040722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ea529a83144054804bb302356166e7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:26.060130 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1120/2220] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:54:25 2022] DELETE /identity/v3/users/62ea529a83144054804bb302356166e7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:26.064695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c277-2cc0-4b4e-9921-897a32787840 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:26.065196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c277-2cc0-4b4e-9921-897a32787840 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:26.065278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c277-2cc0-4b4e-9921-897a32787840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:26.088206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-dff3c277-2cc0-4b4e-9921-897a32787840 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:26.090556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dff3c277-2cc0-4b4e-9921-897a32787840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:26.149007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:26.166036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1101/2221] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:26.175910 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:26.177337 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:26.245938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f031a-7095-4429-abe3-1f90a2485c13 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:26.250017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843d892-29ec-450e-bea5-25500cbffd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:26.251466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d892-29ec-450e-bea5-25500cbffd01 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:26.251883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d892-29ec-450e-bea5-25500cbffd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:26.252063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d892-29ec-450e-bea5-25500cbffd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:26.262389 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843d892-29ec-450e-bea5-25500cbffd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:26.263894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843d892-29ec-450e-bea5-25500cbffd01 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:26.274710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1121/2222] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:26.610339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3c277-2cc0-4b4e-9921-897a32787840 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:26.612132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-dff3c277-2cc0-4b4e-9921-897a32787840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:26.625810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3c277-2cc0-4b4e-9921-897a32787840 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:26.630504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:26.631146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:26.631500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:26.631778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] PATH_INFO: `/v3/projects/34f9f43c98a444999312cf72ad050914` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:26.632909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f9f43c98a444999312cf72ad050914)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:26.634816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:26.684076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f9f43c98a444999312cf72ad050914', 'request_id': 'req-26cbe21e-6c70-4571-bde3-7cd1549581ab'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:26.690485 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f9f43c98a444999312cf72ad050914', 'request_id': 'req-26cbe21e-6c70-4571-bde3-7cd1549581ab'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:26.698065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f9f43c98a444999312cf72ad050914', 'request_id': 'req-26cbe21e-6c70-4571-bde3-7cd1549581ab'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:26.709580 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] The token cache is being invalidate because project 34f9f43c98a444999312cf72ad050914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:54:26.710448 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:26.711175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-26cbe21e-6c70-4571-bde3-7cd1549581ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:26.712800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1102/2223] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:54:26 2022] DELETE /identity/v3/projects/34f9f43c98a444999312cf72ad050914 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:26.717809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886251d-8db7-4e38-bea2-20c91d03cc23 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:26.718169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886251d-8db7-4e38-bea2-20c91d03cc23 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:26.718534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886251d-8db7-4e38-bea2-20c91d03cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:26.739140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-f886251d-8db7-4e38-bea2-20c91d03cc23 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:26.740615 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f886251d-8db7-4e38-bea2-20c91d03cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:26.801824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1122/2224] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:26.809672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da26c7-0e4f-4cc4-9c64-ffa3aa9f7cbb None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:26.809963 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da26c7-0e4f-4cc4-9c64-ffa3aa9f7cbb None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:26.810236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da26c7-0e4f-4cc4-9c64-ffa3aa9f7cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:26.831405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-41da26c7-0e4f-4cc4-9c64-ffa3aa9f7cbb None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:26.832631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-41da26c7-0e4f-4cc4-9c64-ffa3aa9f7cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:26.846063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1103/2225] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:54:26.847422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886251d-8db7-4e38-bea2-20c91d03cc23 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:26.857710 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886251d-8db7-4e38-bea2-20c91d03cc23 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:26.862634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9df473-4499-4fba-952a-d061154c801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:26.863387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df473-4499-4fba-952a-d061154c801d admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:26.863777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df473-4499-4fba-952a-d061154c801d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:26.864138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df473-4499-4fba-952a-d061154c801d admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:26.864898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9df473-4499-4fba-952a-d061154c801d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:54:26.865274 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9df473-4499-4fba-952a-d061154c801d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:26.867019 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9df473-4499-4fba-952a-d061154c801d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:26.884314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1123/2226] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:54:26.885516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da26c7-0e4f-4cc4-9c64-ffa3aa9f7cbb None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:26.895435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da26c7-0e4f-4cc4-9c64-ffa3aa9f7cbb None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:26.900934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00676ac1-37ca-4746-a20b-a3f01b5cf612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:26.901550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00676ac1-37ca-4746-a20b-a3f01b5cf612 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:26.901837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00676ac1-37ca-4746-a20b-a3f01b5cf612 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:26.902114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00676ac1-37ca-4746-a20b-a3f01b5cf612 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:26.902767 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00676ac1-37ca-4746-a20b-a3f01b5cf612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:26.904737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00676ac1-37ca-4746-a20b-a3f01b5cf612 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:26.937720 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1104/2227] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:54:26 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:54:26.938798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9df473-4499-4fba-952a-d061154c801d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:26.949825 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9df473-4499-4fba-952a-d061154c801d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:27.008919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e6ee2-8987-473f-81af-1fb091fd2e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:27.009536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e6ee2-8987-473f-81af-1fb091fd2e03 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.009814 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e6ee2-8987-473f-81af-1fb091fd2e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.010085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e6ee2-8987-473f-81af-1fb091fd2e03 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.010720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e6ee2-8987-473f-81af-1fb091fd2e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:27.012668 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e6ee2-8987-473f-81af-1fb091fd2e03 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:27.022044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:27.039498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1124/2228] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:54:26 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:27.040687 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00676ac1-37ca-4746-a20b-a3f01b5cf612 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:27.050847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00676ac1-37ca-4746-a20b-a3f01b5cf612 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:27.056148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e1f25-101b-46a7-a279-34f5f4c02fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:27.056754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e1f25-101b-46a7-a279-34f5f4c02fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.057039 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e1f25-101b-46a7-a279-34f5f4c02fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.057310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e1f25-101b-46a7-a279-34f5f4c02fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.057978 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e1f25-101b-46a7-a279-34f5f4c02fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:27.059600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e1f25-101b-46a7-a279-34f5f4c02fa8 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:27.070427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1105/2229] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:54:27.074952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e6ee2-8987-473f-81af-1fb091fd2e03 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:27.085685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e6ee2-8987-473f-81af-1fb091fd2e03 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:27.090661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4105c-2e37-4e4a-8954-599731631178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:27.091266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4105c-2e37-4e4a-8954-599731631178 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.091575 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4105c-2e37-4e4a-8954-599731631178 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.091849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4105c-2e37-4e4a-8954-599731631178 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.092518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4105c-2e37-4e4a-8954-599731631178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:27.094130 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4105c-2e37-4e4a-8954-599731631178 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:27.105074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1125/2230] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:27.109264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e1f25-101b-46a7-a279-34f5f4c02fa8 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:27.120323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e1f25-101b-46a7-a279-34f5f4c02fa8 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:27.125088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c070e-8ef4-4b51-888b-fb7dd38411ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:27.125780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c070e-8ef4-4b51-888b-fb7dd38411ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.126062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c070e-8ef4-4b51-888b-fb7dd38411ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.126340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c070e-8ef4-4b51-888b-fb7dd38411ad admin admin] PATH_INFO: `/v3/projects/be9557694d1a4e45afcf2c4594e362ad/users/34a471a4eb424bfe9ae6177e778e8a0b/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.142904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c070e-8ef4-4b51-888b-fb7dd38411ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9557694d1a4e45afcf2c4594e362ad, user_id=34a471a4eb424bfe9ae6177e778e8a0b, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:27.145603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c070e-8ef4-4b51-888b-fb7dd38411ad admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:27.159078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1106/2231] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:27 2022] PUT /identity/v3/projects/be9557694d1a4e45afcf2c4594e362ad/users/34a471a4eb424bfe9ae6177e778e8a0b/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:27.169569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0c33-c43a-45a1-82b1-fff6585c3286 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.170232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0c33-c43a-45a1-82b1-fff6585c3286 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.170232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0c33-c43a-45a1-82b1-fff6585c3286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.202098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-eaff0c33-c43a-45a1-82b1-fff6585c3286 None None] MFA Rules not processed for user `34a471a4eb424bfe9ae6177e778e8a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:27.202098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-eaff0c33-c43a-45a1-82b1-fff6585c3286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:27.280967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1126/2232] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:27.285581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c070e-8ef4-4b51-888b-fb7dd38411ad admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:27.352992 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c070e-8ef4-4b51-888b-fb7dd38411ad admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:27.357990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec893bee-6b14-4d7b-bf8a-20a66d1333f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:27.358700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec893bee-6b14-4d7b-bf8a-20a66d1333f1 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.358921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec893bee-6b14-4d7b-bf8a-20a66d1333f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.359697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec893bee-6b14-4d7b-bf8a-20a66d1333f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.359993 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec893bee-6b14-4d7b-bf8a-20a66d1333f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:27.362178 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec893bee-6b14-4d7b-bf8a-20a66d1333f1 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:27.380701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:27.394814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1107/2233] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:54:27 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:54:27.398872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0c33-c43a-45a1-82b1-fff6585c3286 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:27.411709 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0c33-c43a-45a1-82b1-fff6585c3286 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:27.494278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f28c-0f8d-40e1-8220-4e6506e713fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:27.495476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f28c-0f8d-40e1-8220-4e6506e713fb admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.495900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f28c-0f8d-40e1-8220-4e6506e713fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.496609 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f28c-0f8d-40e1-8220-4e6506e713fb admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.497344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005f28c-0f8d-40e1-8220-4e6506e713fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:27.500031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005f28c-0f8d-40e1-8220-4e6506e713fb admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:27.532151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1127/2234] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:54:27 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:27.536189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec893bee-6b14-4d7b-bf8a-20a66d1333f1 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:27.548182 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec893bee-6b14-4d7b-bf8a-20a66d1333f1 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:27.554465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cc140-83e1-47cc-9517-6502b6a5c738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:27.555415 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc140-83e1-47cc-9517-6502b6a5c738 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.555913 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc140-83e1-47cc-9517-6502b6a5c738 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.556472 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc140-83e1-47cc-9517-6502b6a5c738 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.557342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cc140-83e1-47cc-9517-6502b6a5c738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:27.559225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cc140-83e1-47cc-9517-6502b6a5c738 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:27.573016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1108/2235] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:27.577283 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f28c-0f8d-40e1-8220-4e6506e713fb admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:27.588951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f28c-0f8d-40e1-8220-4e6506e713fb admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:27.595630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931112c7-9fe0-4691-bb4c-fbe40bbbd155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:27.596329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931112c7-9fe0-4691-bb4c-fbe40bbbd155 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.596687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931112c7-9fe0-4691-bb4c-fbe40bbbd155 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.597044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931112c7-9fe0-4691-bb4c-fbe40bbbd155 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.597769 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931112c7-9fe0-4691-bb4c-fbe40bbbd155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:27.600256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931112c7-9fe0-4691-bb4c-fbe40bbbd155 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:27.617187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1128/2236] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:27.618407 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cc140-83e1-47cc-9517-6502b6a5c738 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:27.632020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cc140-83e1-47cc-9517-6502b6a5c738 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:27.637390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ce980-78c3-463e-ae11-e799d792b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:27.638264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ce980-78c3-463e-ae11-e799d792b8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.638834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ce980-78c3-463e-ae11-e799d792b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.639270 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ce980-78c3-463e-ae11-e799d792b8f7 admin admin] PATH_INFO: `/v3/projects/e0ce90de00cc4d6abb4b06e5f2cf7c7b/users/7904fc35c4bc4955bb6b53e74d14789d/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.658887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ce980-78c3-463e-ae11-e799d792b8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ce90de00cc4d6abb4b06e5f2cf7c7b, user_id=7904fc35c4bc4955bb6b53e74d14789d, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:27.666146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ce980-78c3-463e-ae11-e799d792b8f7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:27.680225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1109/2237] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:27 2022] PUT /identity/v3/projects/e0ce90de00cc4d6abb4b06e5f2cf7c7b/users/7904fc35c4bc4955bb6b53e74d14789d/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:27.691428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc10e9-5a1f-4bff-a9a0-401776566e68 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.691712 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc10e9-5a1f-4bff-a9a0-401776566e68 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.691984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc10e9-5a1f-4bff-a9a0-401776566e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.722915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-35cc10e9-5a1f-4bff-a9a0-401776566e68 None None] MFA Rules not processed for user `7904fc35c4bc4955bb6b53e74d14789d`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:27.724251 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-35cc10e9-5a1f-4bff-a9a0-401776566e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:27.766797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:27.798796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1129/2238] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:27.803553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ce980-78c3-463e-ae11-e799d792b8f7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:27.874879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ce980-78c3-463e-ae11-e799d792b8f7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:27.880121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb509b3-3cd0-42e3-b2e8-45eaaf8d4e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:27.881427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb509b3-3cd0-42e3-b2e8-45eaaf8d4e44 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:27.882078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb509b3-3cd0-42e3-b2e8-45eaaf8d4e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:27.882358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb509b3-3cd0-42e3-b2e8-45eaaf8d4e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:27.883119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb509b3-3cd0-42e3-b2e8-45eaaf8d4e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:27.885342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb509b3-3cd0-42e3-b2e8-45eaaf8d4e44 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:27.919838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1110/2239] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:54:27 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:27.921401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc10e9-5a1f-4bff-a9a0-401776566e68 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:27.937376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc10e9-5a1f-4bff-a9a0-401776566e68 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:28.002431 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a2bec-6200-4295-a532-980794e7cda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:28.003129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a2bec-6200-4295-a532-980794e7cda6 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:28.003374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a2bec-6200-4295-a532-980794e7cda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:28.003653 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a2bec-6200-4295-a532-980794e7cda6 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:28.004283 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a2bec-6200-4295-a532-980794e7cda6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:28.006207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a2bec-6200-4295-a532-980794e7cda6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:28.034510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1130/2240] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:54:27 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:54:28.036458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb509b3-3cd0-42e3-b2e8-45eaaf8d4e44 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:28.048690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb509b3-3cd0-42e3-b2e8-45eaaf8d4e44 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:28.053638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301315-7912-4572-96cd-c7455741d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:28.054277 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301315-7912-4572-96cd-c7455741d3ed admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:28.054683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301315-7912-4572-96cd-c7455741d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:28.054964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301315-7912-4572-96cd-c7455741d3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:28.055648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301315-7912-4572-96cd-c7455741d3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:28.057265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301315-7912-4572-96cd-c7455741d3ed admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:28.068470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1111/2241] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:28.073588 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a2bec-6200-4295-a532-980794e7cda6 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:28.086222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a2bec-6200-4295-a532-980794e7cda6 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:28.091569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7533d7a-b250-4361-adac-0a28b6c5b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:28.092245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7533d7a-b250-4361-adac-0a28b6c5b97e admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:28.092518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7533d7a-b250-4361-adac-0a28b6c5b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:28.092797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7533d7a-b250-4361-adac-0a28b6c5b97e admin admin] PATH_INFO: `/v3/projects/df1bb7e04a114e39b1b09e893b6a3bc8/users/7a5123ce194b4710a54a245f1be36b0a/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:28.112743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7533d7a-b250-4361-adac-0a28b6c5b97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1bb7e04a114e39b1b09e893b6a3bc8, user_id=7a5123ce194b4710a54a245f1be36b0a, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:28.115582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7533d7a-b250-4361-adac-0a28b6c5b97e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:28.132471 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1131/2242] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:28 2022] PUT /identity/v3/projects/df1bb7e04a114e39b1b09e893b6a3bc8/users/7a5123ce194b4710a54a245f1be36b0a/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:28.136481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301315-7912-4572-96cd-c7455741d3ed admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:28.147966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301315-7912-4572-96cd-c7455741d3ed admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:28.209185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b7c35-7d6c-4dd8-a0ae-61eadaa8255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:28.210646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b7c35-7d6c-4dd8-a0ae-61eadaa8255a admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:28.211027 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b7c35-7d6c-4dd8-a0ae-61eadaa8255a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:28.211433 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b7c35-7d6c-4dd8-a0ae-61eadaa8255a admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:28.212244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b7c35-7d6c-4dd8-a0ae-61eadaa8255a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:28.214004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b7c35-7d6c-4dd8-a0ae-61eadaa8255a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:28.227379 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1112/2243] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:28.229453 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7533d7a-b250-4361-adac-0a28b6c5b97e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:28.239952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7533d7a-b250-4361-adac-0a28b6c5b97e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:28.245295 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a00fe0-35ad-4725-876f-4448628f25ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:28.246118 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a00fe0-35ad-4725-876f-4448628f25ed admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:28.246506 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a00fe0-35ad-4725-876f-4448628f25ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:28.246882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a00fe0-35ad-4725-876f-4448628f25ed admin admin] PATH_INFO: `/v3/projects/df1bb7e04a114e39b1b09e893b6a3bc8/users/7a5123ce194b4710a54a245f1be36b0a/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:28.249018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a00fe0-35ad-4725-876f-4448628f25ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1bb7e04a114e39b1b09e893b6a3bc8, user_id=7a5123ce194b4710a54a245f1be36b0a, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:28.251854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a00fe0-35ad-4725-876f-4448628f25ed admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:28.264377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1132/2244] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:28 2022] PUT /identity/v3/projects/df1bb7e04a114e39b1b09e893b6a3bc8/users/7a5123ce194b4710a54a245f1be36b0a/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:54:28.274907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e0e2-41f3-400d-8b2a-8b38f23c8cf3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:28.275362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e0e2-41f3-400d-8b2a-8b38f23c8cf3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:28.275710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e0e2-41f3-400d-8b2a-8b38f23c8cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:28.307321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-fb62e0e2-41f3-400d-8b2a-8b38f23c8cf3 None None] MFA Rules not processed for user `7a5123ce194b4710a54a245f1be36b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:28.308689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fb62e0e2-41f3-400d-8b2a-8b38f23c8cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:28.328869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:28.383716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1113/2245] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:54:28.395740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a00fe0-35ad-4725-876f-4448628f25ed admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:28.398198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-41a00fe0-35ad-4725-876f-4448628f25ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:28.458835 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a00fe0-35ad-4725-876f-4448628f25ed admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:28.462616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16390b-d5a0-4966-9581-a0e22e5c4b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:28.463241 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16390b-d5a0-4966-9581-a0e22e5c4b1a service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:28.463554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16390b-d5a0-4966-9581-a0e22e5c4b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:28.463884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16390b-d5a0-4966-9581-a0e22e5c4b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:28.511552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:28.531069 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16390b-d5a0-4966-9581-a0e22e5c4b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:28.532586 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16390b-d5a0-4966-9581-a0e22e5c4b1a service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:28.542521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1133/2246] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:29.858468 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62e0e2-41f3-400d-8b2a-8b38f23c8cf3 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:29.859961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-fb62e0e2-41f3-400d-8b2a-8b38f23c8cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:29.944797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62e0e2-41f3-400d-8b2a-8b38f23c8cf3 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:29.957002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a5443-ccff-4086-9098-89da37c5b192 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:29.957797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a5443-ccff-4086-9098-89da37c5b192 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:29.958557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a5443-ccff-4086-9098-89da37c5b192 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:29.959075 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a5443-ccff-4086-9098-89da37c5b192 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:29.961054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-298a5443-ccff-4086-9098-89da37c5b192 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:30.036175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a5443-ccff-4086-9098-89da37c5b192 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:30.038197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a5443-ccff-4086-9098-89da37c5b192 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:30.067527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1114/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:30.143122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16390b-d5a0-4966-9581-a0e22e5c4b1a service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:30.144651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5b16390b-d5a0-4966-9581-a0e22e5c4b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:30.160790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16390b-d5a0-4966-9581-a0e22e5c4b1a service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:30.166012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e8f00-ad9c-4ed9-ab41-392d671e8992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:30.166698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e8f00-ad9c-4ed9-ab41-392d671e8992 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:30.167115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e8f00-ad9c-4ed9-ab41-392d671e8992 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:30.167429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e8f00-ad9c-4ed9-ab41-392d671e8992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:30.232239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e8f00-ad9c-4ed9-ab41-392d671e8992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:30.233685 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e8f00-ad9c-4ed9-ab41-392d671e8992 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:30.243479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1134/2248] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:30.976151 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a5443-ccff-4086-9098-89da37c5b192 service nova] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:30.985799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a5443-ccff-4086-9098-89da37c5b192 service nova] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:30.989370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b312fb-04df-47e2-966a-fce33530d6d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:30.989982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b312fb-04df-47e2-966a-fce33530d6d5 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:30.990241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b312fb-04df-47e2-966a-fce33530d6d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:30.990512 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b312fb-04df-47e2-966a-fce33530d6d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:31.000087 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b312fb-04df-47e2-966a-fce33530d6d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:31.001508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b312fb-04df-47e2-966a-fce33530d6d5 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:31.011474 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1115/2249] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:34.909860 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e8f00-ad9c-4ed9-ab41-392d671e8992 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:34.973004 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e8f00-ad9c-4ed9-ab41-392d671e8992 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:34.978051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:34.978683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:34.978964 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:34.979241 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] PATH_INFO: `/v3/users/34a471a4eb424bfe9ae6177e778e8a0b` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:34.980391 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a471a4eb424bfe9ae6177e778e8a0b)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:34.982292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:35.030672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a471a4eb424bfe9ae6177e778e8a0b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.038245 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a471a4eb424bfe9ae6177e778e8a0b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.038990 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a471a4eb424bfe9ae6177e778e8a0b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.039696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a471a4eb424bfe9ae6177e778e8a0b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.047534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a471a4eb424bfe9ae6177e778e8a0b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.071598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1135/2250] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:54:34 2022] DELETE /identity/v3/users/34a471a4eb424bfe9ae6177e778e8a0b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:35.073565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fbd5a-d6f0-4d3a-8792-0434cda5fb20 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:35.074051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fbd5a-d6f0-4d3a-8792-0434cda5fb20 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:35.074146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fbd5a-d6f0-4d3a-8792-0434cda5fb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:35.094989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-8e2fbd5a-d6f0-4d3a-8792-0434cda5fb20 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:35.096255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8e2fbd5a-d6f0-4d3a-8792-0434cda5fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:35.134490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:35.161303 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1116/2251] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:35.172205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:35.173680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:35.179917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:35.243240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b4bc5-ecec-4ac5-934b-61e4b959600e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:35.248241 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae926c6-f008-4181-8b62-6857e47459eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:35.248883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae926c6-f008-4181-8b62-6857e47459eb service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:35.249448 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae926c6-f008-4181-8b62-6857e47459eb service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:35.249857 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae926c6-f008-4181-8b62-6857e47459eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:35.265920 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae926c6-f008-4181-8b62-6857e47459eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:35.267682 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae926c6-f008-4181-8b62-6857e47459eb service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:35.280267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1136/2252] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:35.546968 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fbd5a-d6f0-4d3a-8792-0434cda5fb20 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:35.548467 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8e2fbd5a-d6f0-4d3a-8792-0434cda5fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:35.560383 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fbd5a-d6f0-4d3a-8792-0434cda5fb20 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:35.565053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:35.565699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:35.565985 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:35.566266 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] PATH_INFO: `/v3/projects/be9557694d1a4e45afcf2c4594e362ad` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:35.567431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9557694d1a4e45afcf2c4594e362ad)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:35.569889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:35.618496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9557694d1a4e45afcf2c4594e362ad', 'request_id': 'req-eaa87a37-abfb-4546-8e04-71e168dbaaf8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.624762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9557694d1a4e45afcf2c4594e362ad', 'request_id': 'req-eaa87a37-abfb-4546-8e04-71e168dbaaf8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.632478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9557694d1a4e45afcf2c4594e362ad', 'request_id': 'req-eaa87a37-abfb-4546-8e04-71e168dbaaf8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.642766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] The token cache is being invalidate because project be9557694d1a4e45afcf2c4594e362ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:54:35.643054 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.643700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.645249 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1117/2253] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:54:35 2022] DELETE /identity/v3/projects/be9557694d1a4e45afcf2c4594e362ad => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:35.649775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae926c6-f008-4181-8b62-6857e47459eb service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:35.659485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae926c6-f008-4181-8b62-6857e47459eb service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:35.716092 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:35.716731 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:35.717012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:35.717289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] PATH_INFO: `/v3/users/7904fc35c4bc4955bb6b53e74d14789d` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:35.718400 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7904fc35c4bc4955bb6b53e74d14789d)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:35.720359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:35.770272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7904fc35c4bc4955bb6b53e74d14789d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.778838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7904fc35c4bc4955bb6b53e74d14789d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.779577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7904fc35c4bc4955bb6b53e74d14789d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.780198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7904fc35c4bc4955bb6b53e74d14789d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.788263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7904fc35c4bc4955bb6b53e74d14789d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:35.807441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1137/2254] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:54:35 2022] DELETE /identity/v3/users/7904fc35c4bc4955bb6b53e74d14789d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:36.078849 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:36.080431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:36.094219 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa87a37-abfb-4546-8e04-71e168dbaaf8 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:36.149663 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:36.150220 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:36.150498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:36.150771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] PATH_INFO: `/v3/projects/e0ce90de00cc4d6abb4b06e5f2cf7c7b` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:36.151889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ce90de00cc4d6abb4b06e5f2cf7c7b)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:36.153776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:36.199241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ce90de00cc4d6abb4b06e5f2cf7c7b', 'request_id': 'req-ff14c206-52a5-42fe-8790-27dded2adafc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.205656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ce90de00cc4d6abb4b06e5f2cf7c7b', 'request_id': 'req-ff14c206-52a5-42fe-8790-27dded2adafc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.213055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ce90de00cc4d6abb4b06e5f2cf7c7b', 'request_id': 'req-ff14c206-52a5-42fe-8790-27dded2adafc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.217094 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:36.227242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] The token cache is being invalidate because project e0ce90de00cc4d6abb4b06e5f2cf7c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:54:36.227557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.228183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.229672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1118/2255] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:54:36 2022] DELETE /identity/v3/projects/e0ce90de00cc4d6abb4b06e5f2cf7c7b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:36.233858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:36.235239 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:36.249192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618821cb-e5d1-4122-8702-59f38a2f322f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:36.270351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:36.312288 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:36.312875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:36.313261 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:36.313770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] PATH_INFO: `/v3/users/7a5123ce194b4710a54a245f1be36b0a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:36.315332 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5123ce194b4710a54a245f1be36b0a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:36.317384 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:36.372535 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5123ce194b4710a54a245f1be36b0a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.379941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5123ce194b4710a54a245f1be36b0a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.380617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5123ce194b4710a54a245f1be36b0a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.381347 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5123ce194b4710a54a245f1be36b0a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.388230 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-92d30f6a-efa0-4cd0-8d48-2f47948a287b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5123ce194b4710a54a245f1be36b0a'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.408009 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1138/2256] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:54:36 2022] DELETE /identity/v3/users/7a5123ce194b4710a54a245f1be36b0a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:36.689026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:36.690613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:36.706891 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14c206-52a5-42fe-8790-27dded2adafc admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:36.768510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:36.769167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:36.769530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:36.769806 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] PATH_INFO: `/v3/projects/df1bb7e04a114e39b1b09e893b6a3bc8` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:36.770915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1bb7e04a114e39b1b09e893b6a3bc8)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:36.773371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:36.819234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1bb7e04a114e39b1b09e893b6a3bc8', 'request_id': 'req-6cb7bde0-854c-4bc2-bb49-c069712570dc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.825455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1bb7e04a114e39b1b09e893b6a3bc8', 'request_id': 'req-6cb7bde0-854c-4bc2-bb49-c069712570dc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.832870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1bb7e04a114e39b1b09e893b6a3bc8', 'request_id': 'req-6cb7bde0-854c-4bc2-bb49-c069712570dc'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.843660 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] The token cache is being invalidate because project df1bb7e04a114e39b1b09e893b6a3bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:54:36.843943 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.844568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cb7bde0-854c-4bc2-bb49-c069712570dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:36.846040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1119/2257] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:54:36 2022] DELETE /identity/v3/projects/df1bb7e04a114e39b1b09e893b6a3bc8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:36.851501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e0c23-2e35-434f-9b8d-a13332a8895b None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:36.851790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e0c23-2e35-434f-9b8d-a13332a8895b None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:36.852066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e0c23-2e35-434f-9b8d-a13332a8895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:36.871512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-799e0c23-2e35-434f-9b8d-a13332a8895b None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:36.872683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-799e0c23-2e35-434f-9b8d-a13332a8895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:36.931474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1139/2258] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:36.937991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f89c-6491-4517-a9c8-f3c063b238d9 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:36.938306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f89c-6491-4517-a9c8-f3c063b238d9 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:36.938530 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f89c-6491-4517-a9c8-f3c063b238d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:36.957905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ee90f89c-6491-4517-a9c8-f3c063b238d9 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:36.959096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ee90f89c-6491-4517-a9c8-f3c063b238d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:36.967870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1120/2259] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:36.973412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e0c23-2e35-434f-9b8d-a13332a8895b None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:36.983941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e0c23-2e35-434f-9b8d-a13332a8895b None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:36.988561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60691d-93fc-44c7-acb2-8a68e2ce3e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:36.989160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60691d-93fc-44c7-acb2-8a68e2ce3e91 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:36.989437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60691d-93fc-44c7-acb2-8a68e2ce3e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:36.989711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60691d-93fc-44c7-acb2-8a68e2ce3e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:36.990354 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60691d-93fc-44c7-acb2-8a68e2ce3e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:54:36.990717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60691d-93fc-44c7-acb2-8a68e2ce3e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:36.992456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60691d-93fc-44c7-acb2-8a68e2ce3e91 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:37.005272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1140/2260] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:54:37.009248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f89c-6491-4517-a9c8-f3c063b238d9 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:37.019003 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f89c-6491-4517-a9c8-f3c063b238d9 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:37.025798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da510e5a-b1d1-4878-842e-b5d5a48bd4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:37.026404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510e5a-b1d1-4878-842e-b5d5a48bd4ad admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:37.026683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510e5a-b1d1-4878-842e-b5d5a48bd4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:37.027024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510e5a-b1d1-4878-842e-b5d5a48bd4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:37.027810 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da510e5a-b1d1-4878-842e-b5d5a48bd4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:37.029700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da510e5a-b1d1-4878-842e-b5d5a48bd4ad admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:37.057636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1121/2261] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:54:37 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:37.062025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60691d-93fc-44c7-acb2-8a68e2ce3e91 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:37.073054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60691d-93fc-44c7-acb2-8a68e2ce3e91 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:37.103973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:37.133880 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260aea1-084f-448f-939d-187da47d0fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:37.134498 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260aea1-084f-448f-939d-187da47d0fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:37.134787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260aea1-084f-448f-939d-187da47d0fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:37.135067 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260aea1-084f-448f-939d-187da47d0fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:37.135729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260aea1-084f-448f-939d-187da47d0fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:37.137644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260aea1-084f-448f-939d-187da47d0fd3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:37.163654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1141/2262] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:54:37 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:54:37.167749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da510e5a-b1d1-4878-842e-b5d5a48bd4ad admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:37.178803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da510e5a-b1d1-4878-842e-b5d5a48bd4ad admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:37.183775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0cd64-af4e-4880-afc3-23f57f057a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:37.184297 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0cd64-af4e-4880-afc3-23f57f057a0d admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:37.184579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0cd64-af4e-4880-afc3-23f57f057a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:37.184856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0cd64-af4e-4880-afc3-23f57f057a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:37.185496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0cd64-af4e-4880-afc3-23f57f057a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:37.187085 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0cd64-af4e-4880-afc3-23f57f057a0d admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:37.203432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260aea1-084f-448f-939d-187da47d0fd3 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:37.203631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1122/2263] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:37.216425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260aea1-084f-448f-939d-187da47d0fd3 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:37.221536 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65c13c-3652-46a4-a12d-006edec294df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:37.222329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c13c-3652-46a4-a12d-006edec294df admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:37.222615 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c13c-3652-46a4-a12d-006edec294df admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:37.222941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c13c-3652-46a4-a12d-006edec294df admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:37.223617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65c13c-3652-46a4-a12d-006edec294df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:37.225274 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65c13c-3652-46a4-a12d-006edec294df admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:37.239006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1142/2264] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:54:37.240152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0cd64-af4e-4880-afc3-23f57f057a0d admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:37.250245 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0cd64-af4e-4880-afc3-23f57f057a0d admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:37.255453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f108d7-5955-4273-81e7-0d16a71d3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:37.256611 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f108d7-5955-4273-81e7-0d16a71d3e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:37.256881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f108d7-5955-4273-81e7-0d16a71d3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:37.257160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f108d7-5955-4273-81e7-0d16a71d3e2f admin admin] PATH_INFO: `/v3/projects/e14b19065d6f44a084590651fc2da894/users/ffbf8d07d4f94256a00a647a66c38e62/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:37.272741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f108d7-5955-4273-81e7-0d16a71d3e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14b19065d6f44a084590651fc2da894, user_id=ffbf8d07d4f94256a00a647a66c38e62, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:37.275436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f108d7-5955-4273-81e7-0d16a71d3e2f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:37.288562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1123/2265] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:54:37 2022] PUT /identity/v3/projects/e14b19065d6f44a084590651fc2da894/users/ffbf8d07d4f94256a00a647a66c38e62/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:54:37.293787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4c810-fed8-4010-8580-382c450d6a32 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:37.294136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4c810-fed8-4010-8580-382c450d6a32 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:37.294416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4c810-fed8-4010-8580-382c450d6a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:37.314070 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-8aa4c810-fed8-4010-8580-382c450d6a32 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:37.315325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8aa4c810-fed8-4010-8580-382c450d6a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:37.377676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1143/2266] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:37.387913 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f108d7-5955-4273-81e7-0d16a71d3e2f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:37.389607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c6f108d7-5955-4273-81e7-0d16a71d3e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:37.412061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:37.448871 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f108d7-5955-4273-81e7-0d16a71d3e2f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:37.452563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27988d7-597e-4d32-be13-6b45a44b85f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:37.453418 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27988d7-597e-4d32-be13-6b45a44b85f9 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:37.453702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27988d7-597e-4d32-be13-6b45a44b85f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:37.453976 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27988d7-597e-4d32-be13-6b45a44b85f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:37.462962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27988d7-597e-4d32-be13-6b45a44b85f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:37.464418 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27988d7-597e-4d32-be13-6b45a44b85f9 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:37.474036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1124/2267] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:38.115366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688981-f967-472d-a16f-50890a8fa2a5 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:38.116432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688981-f967-472d-a16f-50890a8fa2a5 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:38.116874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688981-f967-472d-a16f-50890a8fa2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:38.152339 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-fe688981-f967-472d-a16f-50890a8fa2a5 None None] MFA Rules not processed for user `ffbf8d07d4f94256a00a647a66c38e62`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:38.153571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fe688981-f967-472d-a16f-50890a8fa2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:38.227880 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1144/2268] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:38.238801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27988d7-597e-4d32-be13-6b45a44b85f9 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:38.240802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d27988d7-597e-4d32-be13-6b45a44b85f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:38.305241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27988d7-597e-4d32-be13-6b45a44b85f9 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:38.308915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024807a-6c5d-44d9-96f9-90266ae09dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:38.309523 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024807a-6c5d-44d9-96f9-90266ae09dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:38.309809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024807a-6c5d-44d9-96f9-90266ae09dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:38.310088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024807a-6c5d-44d9-96f9-90266ae09dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:38.318821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024807a-6c5d-44d9-96f9-90266ae09dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:38.320299 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024807a-6c5d-44d9-96f9-90266ae09dc0 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:38.329180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1125/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:39.682060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976cd63-efcd-48a9-bcdf-a096de105e41 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:39.682547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976cd63-efcd-48a9-bcdf-a096de105e41 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:39.682661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976cd63-efcd-48a9-bcdf-a096de105e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:39.701655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d976cd63-efcd-48a9-bcdf-a096de105e41 None None] MFA Rules not processed for user `ffbf8d07d4f94256a00a647a66c38e62`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:39.702846 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d976cd63-efcd-48a9-bcdf-a096de105e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:39.710961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1145/2270] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:39.954117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024807a-6c5d-44d9-96f9-90266ae09dc0 service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:39.964034 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024807a-6c5d-44d9-96f9-90266ae09dc0 service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:39.967649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34bf5c-7aa1-4e18-984b-c72f5620013d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:39.968251 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34bf5c-7aa1-4e18-984b-c72f5620013d service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:39.968533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34bf5c-7aa1-4e18-984b-c72f5620013d service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:39.968829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34bf5c-7aa1-4e18-984b-c72f5620013d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:39.970550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4c34bf5c-7aa1-4e18-984b-c72f5620013d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:39.980730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34bf5c-7aa1-4e18-984b-c72f5620013d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:39.982207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34bf5c-7aa1-4e18-984b-c72f5620013d service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:39.990543 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1126/2271] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:40.313319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976cd63-efcd-48a9-bcdf-a096de105e41 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:40.314789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d976cd63-efcd-48a9-bcdf-a096de105e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:40.351545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:40.393479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976cd63-efcd-48a9-bcdf-a096de105e41 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:40.398950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dab079-3993-41dc-ba03-8ef95c18877f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:40.399579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dab079-3993-41dc-ba03-8ef95c18877f service placement] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:40.399859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dab079-3993-41dc-ba03-8ef95c18877f service placement] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:40.400128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dab079-3993-41dc-ba03-8ef95c18877f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:40.401817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-86dab079-3993-41dc-ba03-8ef95c18877f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:40.413027 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dab079-3993-41dc-ba03-8ef95c18877f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:40.414590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dab079-3993-41dc-ba03-8ef95c18877f service placement] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:40.424151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1146/2272] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:54:44.991105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34bf5c-7aa1-4e18-984b-c72f5620013d service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:44.993295 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4c34bf5c-7aa1-4e18-984b-c72f5620013d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:45.009194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34bf5c-7aa1-4e18-984b-c72f5620013d service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:45.013825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:45.014658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:45.014945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:45.015226 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] PATH_INFO: `/v3/users/aa37eb12e65a4678a7153d1fdc37bdc5` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:45.016450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa37eb12e65a4678a7153d1fdc37bdc5)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:45.018393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:45.069565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa37eb12e65a4678a7153d1fdc37bdc5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:45.078382 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa37eb12e65a4678a7153d1fdc37bdc5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:45.079364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa37eb12e65a4678a7153d1fdc37bdc5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:45.080139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa37eb12e65a4678a7153d1fdc37bdc5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:45.088809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-24935756-4e50-438f-80a8-b7cad412d1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa37eb12e65a4678a7153d1fdc37bdc5'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:45.108527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1127/2273] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:54:44 2022] DELETE /identity/v3/users/aa37eb12e65a4678a7153d1fdc37bdc5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:45.291788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dab079-3993-41dc-ba03-8ef95c18877f service placement] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:45.309564 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dab079-3993-41dc-ba03-8ef95c18877f service placement] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:45.390260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:45.390756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:45.391036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:45.391421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] PATH_INFO: `/v3/projects/1a061c6fbac44a03b6e58b138ba95ba0` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:45.392546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a061c6fbac44a03b6e58b138ba95ba0)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:45.394454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:45.445083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a061c6fbac44a03b6e58b138ba95ba0', 'request_id': 'req-6d61cc94-0bb2-446b-a111-da4138c402ba'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:45.453328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a061c6fbac44a03b6e58b138ba95ba0', 'request_id': 'req-6d61cc94-0bb2-446b-a111-da4138c402ba'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:45.460602 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a061c6fbac44a03b6e58b138ba95ba0', 'request_id': 'req-6d61cc94-0bb2-446b-a111-da4138c402ba'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:45.471505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] The token cache is being invalidate because project 1a061c6fbac44a03b6e58b138ba95ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:54:45.471740 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:45.472381 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:54:45.473897 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1147/2274] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:54:45 2022] DELETE /identity/v3/projects/1a061c6fbac44a03b6e58b138ba95ba0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:54:53.048169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285c79-0186-417f-a4cb-4c02007c18df None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:53.049183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285c79-0186-417f-a4cb-4c02007c18df None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:53.049691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285c79-0186-417f-a4cb-4c02007c18df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:53.083076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-33285c79-0186-417f-a4cb-4c02007c18df None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:53.085300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-33285c79-0186-417f-a4cb-4c02007c18df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:53.111576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:53.156490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1128/2275] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:54:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:53.215578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:53.219651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:53.299359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:54:53.319540 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61cc94-0bb2-446b-a111-da4138c402ba admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:53.324625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d404c-9342-439a-a86f-49cb11026b79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:53.325255 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d404c-9342-439a-a86f-49cb11026b79 service swift] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:53.325606 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d404c-9342-439a-a86f-49cb11026b79 service swift] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:53.325948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d404c-9342-439a-a86f-49cb11026b79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:53.337437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d404c-9342-439a-a86f-49cb11026b79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:53.340786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d404c-9342-439a-a86f-49cb11026b79 service swift] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:53.351733 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1148/2276] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:54:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:54:55.723917 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4f882-2db8-44fb-9e86-c06e7598af73 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:55.724463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4f882-2db8-44fb-9e86-c06e7598af73 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:55.724463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4f882-2db8-44fb-9e86-c06e7598af73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:55.746968 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0cf4f882-2db8-44fb-9e86-c06e7598af73 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:55.749205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0cf4f882-2db8-44fb-9e86-c06e7598af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:55.757542 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1129/2277] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 04:54:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:54:55.779456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d404c-9342-439a-a86f-49cb11026b79 service swift] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:55.794571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d404c-9342-439a-a86f-49cb11026b79 service swift] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:55.812867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3262f-2490-4c61-a22c-588ea46b8cbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:55.813582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3262f-2490-4c61-a22c-588ea46b8cbf service swift] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:55.813940 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3262f-2490-4c61-a22c-588ea46b8cbf service swift] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:55.814335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3262f-2490-4c61-a22c-588ea46b8cbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:55.825438 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3262f-2490-4c61-a22c-588ea46b8cbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:55.836188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3262f-2490-4c61-a22c-588ea46b8cbf service swift] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:55.848138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1149/2278] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:54:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:54:56.966207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff841016-9b7e-41af-bcb9-4b100222a8ef None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:56.966746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff841016-9b7e-41af-bcb9-4b100222a8ef None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:56.966746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff841016-9b7e-41af-bcb9-4b100222a8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:56.998354 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ff841016-9b7e-41af-bcb9-4b100222a8ef None None] MFA Rules not processed for user `ffbf8d07d4f94256a00a647a66c38e62`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:54:57.000024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ff841016-9b7e-41af-bcb9-4b100222a8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:57.102633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1130/2279] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:54:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:54:57.411989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3262f-2490-4c61-a22c-588ea46b8cbf service swift] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:54:57.414103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-95b3262f-2490-4c61-a22c-588ea46b8cbf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:57.490639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3262f-2490-4c61-a22c-588ea46b8cbf service swift] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:54:57.496019 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d7ef5-dcd0-4d41-9ee8-78e3a3c908f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:54:57.497168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7ef5-dcd0-4d41-9ee8-78e3a3c908f0 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:54:57.497461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7ef5-dcd0-4d41-9ee8-78e3a3c908f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:54:57.497738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7ef5-dcd0-4d41-9ee8-78e3a3c908f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:54:57.499667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-208d7ef5-dcd0-4d41-9ee8-78e3a3c908f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:54:57.510238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d7ef5-dcd0-4d41-9ee8-78e3a3c908f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:54:57.511836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d7ef5-dcd0-4d41-9ee8-78e3a3c908f0 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:54:57.530449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1150/2280] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:54:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:55:01.928254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff841016-9b7e-41af-bcb9-4b100222a8ef None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:01.938807 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff841016-9b7e-41af-bcb9-4b100222a8ef None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:01.946783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8dfc0-a52f-4b2f-8c69-fa38b99b5211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:01.948934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8dfc0-a52f-4b2f-8c69-fa38b99b5211 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:01.950380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8dfc0-a52f-4b2f-8c69-fa38b99b5211 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:01.950918 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8dfc0-a52f-4b2f-8c69-fa38b99b5211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:01.953698 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-45b8dfc0-a52f-4b2f-8c69-fa38b99b5211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:01.966200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8dfc0-a52f-4b2f-8c69-fa38b99b5211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:01.968877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8dfc0-a52f-4b2f-8c69-fa38b99b5211 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:01.980623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1131/2281] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:55:02.910637 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d7ef5-dcd0-4d41-9ee8-78e3a3c908f0 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:02.912147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-208d7ef5-dcd0-4d41-9ee8-78e3a3c908f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:03.066868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d7ef5-dcd0-4d41-9ee8-78e3a3c908f0 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:03.081368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700993-4b2b-4e1a-b2ab-5e1a4c9c5c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:03.082473 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700993-4b2b-4e1a-b2ab-5e1a4c9c5c4e service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:03.082956 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700993-4b2b-4e1a-b2ab-5e1a4c9c5c4e service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:03.084802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700993-4b2b-4e1a-b2ab-5e1a4c9c5c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:03.087104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-25700993-4b2b-4e1a-b2ab-5e1a4c9c5c4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:03.100580 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25700993-4b2b-4e1a-b2ab-5e1a4c9c5c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:03.102457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25700993-4b2b-4e1a-b2ab-5e1a4c9c5c4e service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:03.115897 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1151/2282] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:55:04.070475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8dfc0-a52f-4b2f-8c69-fa38b99b5211 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:04.072039 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-45b8dfc0-a52f-4b2f-8c69-fa38b99b5211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:04.112643 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8dfc0-a52f-4b2f-8c69-fa38b99b5211 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:04.124488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672602f8-f68a-49a0-8c3f-9e1a6ffbba97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:04.127905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672602f8-f68a-49a0-8c3f-9e1a6ffbba97 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:04.128271 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672602f8-f68a-49a0-8c3f-9e1a6ffbba97 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:04.128618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672602f8-f68a-49a0-8c3f-9e1a6ffbba97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:04.130612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-672602f8-f68a-49a0-8c3f-9e1a6ffbba97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:04.289256 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672602f8-f68a-49a0-8c3f-9e1a6ffbba97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:04.291137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672602f8-f68a-49a0-8c3f-9e1a6ffbba97 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:04.308478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1132/2283] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:55:06.698033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700993-4b2b-4e1a-b2ab-5e1a4c9c5c4e service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:06.700915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-25700993-4b2b-4e1a-b2ab-5e1a4c9c5c4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:06.815329 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:06.823932 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700993-4b2b-4e1a-b2ab-5e1a4c9c5c4e service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:06.830084 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:06.830640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:06.830924 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:06.831200 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] PATH_INFO: `/v3/users/508bedd24344422ab2009a0e96273854` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:06.832457 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=508bedd24344422ab2009a0e96273854)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:06.835271 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:06.887487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508bedd24344422ab2009a0e96273854'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:06.896968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508bedd24344422ab2009a0e96273854'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:06.897850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508bedd24344422ab2009a0e96273854'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:06.899301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508bedd24344422ab2009a0e96273854'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:06.906474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508bedd24344422ab2009a0e96273854'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:06.929394 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1152/2284] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:55:06 2022] DELETE /identity/v3/users/508bedd24344422ab2009a0e96273854 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:55:07.137665 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672602f8-f68a-49a0-8c3f-9e1a6ffbba97 service nova] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:07.164562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672602f8-f68a-49a0-8c3f-9e1a6ffbba97 service nova] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:07.229047 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:07.239978 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:07.241365 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:07.241748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:07.242582 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] PATH_INFO: `/v3/projects/c3e52f04a07245ee8cbe5c85ea8a30b1` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:07.245043 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e52f04a07245ee8cbe5c85ea8a30b1)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:07.247144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:07.300676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e52f04a07245ee8cbe5c85ea8a30b1', 'request_id': 'req-9934850c-a7e8-4bbe-813d-db15e010736a'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.308654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e52f04a07245ee8cbe5c85ea8a30b1', 'request_id': 'req-9934850c-a7e8-4bbe-813d-db15e010736a'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.318689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e52f04a07245ee8cbe5c85ea8a30b1', 'request_id': 'req-9934850c-a7e8-4bbe-813d-db15e010736a'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.330673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] The token cache is being invalidate because project c3e52f04a07245ee8cbe5c85ea8a30b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:55:07.330966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.331635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.333442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1133/2285] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:55:07 2022] DELETE /identity/v3/projects/c3e52f04a07245ee8cbe5c85ea8a30b1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:55:07.338250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:07.339828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:07.354441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b562dc-0876-4555-aee6-4e0139e45d2a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:07.415695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:07.416170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:07.416743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:07.416743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] PATH_INFO: `/v3/users/9a4d6e13f6d442de9dad4d420c2dc795` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:07.418409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4d6e13f6d442de9dad4d420c2dc795)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:07.421715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:07.471755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4d6e13f6d442de9dad4d420c2dc795'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.479416 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4d6e13f6d442de9dad4d420c2dc795'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.480112 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4d6e13f6d442de9dad4d420c2dc795'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.480719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4d6e13f6d442de9dad4d420c2dc795'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.487858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4d6e13f6d442de9dad4d420c2dc795'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.499618 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:07.508296 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1153/2286] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:55:07 2022] DELETE /identity/v3/users/9a4d6e13f6d442de9dad4d420c2dc795 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:55:07.696593 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:07.698016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:07.712762 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934850c-a7e8-4bbe-813d-db15e010736a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:07.775209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:07.775897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:07.776226 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:07.776506 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] PATH_INFO: `/v3/projects/1e740d7948854192a8c37a4b23449292` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:07.777649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e740d7948854192a8c37a4b23449292)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:07.779584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:07.836804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e740d7948854192a8c37a4b23449292', 'request_id': 'req-e2694a4a-9791-4d4d-b7c4-867c41017557'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.851298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e740d7948854192a8c37a4b23449292', 'request_id': 'req-e2694a4a-9791-4d4d-b7c4-867c41017557'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.865840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e740d7948854192a8c37a4b23449292', 'request_id': 'req-e2694a4a-9791-4d4d-b7c4-867c41017557'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.885080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] The token cache is being invalidate because project 1e740d7948854192a8c37a4b23449292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:55:07.885380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.886040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e2694a4a-9791-4d4d-b7c4-867c41017557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:07.887776 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1134/2287] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:55:07 2022] DELETE /identity/v3/projects/1e740d7948854192a8c37a4b23449292 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:55:08.747144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:08.748697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:08.824935 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ada4e-d3d8-450e-ac19-5307f487527a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:08.897270 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d2314-fb10-4f76-b87b-fcfc08bba17e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:08.897973 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d2314-fb10-4f76-b87b-fcfc08bba17e service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:08.898439 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d2314-fb10-4f76-b87b-fcfc08bba17e service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:08.898788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d2314-fb10-4f76-b87b-fcfc08bba17e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:08.901278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a17d2314-fb10-4f76-b87b-fcfc08bba17e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:08.915553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d2314-fb10-4f76-b87b-fcfc08bba17e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:08.917253 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d2314-fb10-4f76-b87b-fcfc08bba17e service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:08.929640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1154/2288] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:55:11.214349 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be979d-5627-40d6-a2da-6d375426b10c None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:11.215216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be979d-5627-40d6-a2da-6d375426b10c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:11.215521 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be979d-5627-40d6-a2da-6d375426b10c None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:11.216907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1135/2289] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:55:11.223175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a75e1f-7c4c-4910-912b-5166ab9274ad None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:11.224220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a75e1f-7c4c-4910-912b-5166ab9274ad None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:11.224342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a75e1f-7c4c-4910-912b-5166ab9274ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:11.246340 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-40a75e1f-7c4c-4910-912b-5166ab9274ad None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:11.247642 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-40a75e1f-7c4c-4910-912b-5166ab9274ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:11.257224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1155/2290] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:55:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:11.272816 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be979d-5627-40d6-a2da-6d375426b10c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:11.274555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-62be979d-5627-40d6-a2da-6d375426b10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:11.291492 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:11.352017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be979d-5627-40d6-a2da-6d375426b10c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:11.355524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e15449-7bac-4bd8-be28-0509866cef26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c894579b2b2943409412afbbfe779aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:11.356133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e15449-7bac-4bd8-be28-0509866cef26 service glance] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:11.356416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e15449-7bac-4bd8-be28-0509866cef26 service glance] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:11.356690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e15449-7bac-4bd8-be28-0509866cef26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:11.369426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e15449-7bac-4bd8-be28-0509866cef26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:11.370951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e15449-7bac-4bd8-be28-0509866cef26 service glance] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:11.382055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1136/2291] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:55:11.453548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04194b62-10c6-49a6-b71c-eb925b4f99e8 None None] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:11.453963 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04194b62-10c6-49a6-b71c-eb925b4f99e8 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:11.454248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04194b62-10c6-49a6-b71c-eb925b4f99e8 None None] PATH_INFO: `/` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:11.455677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1156/2292] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 04:55:11.460768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ed732-fe8e-4cd2-9668-f713edbcddee None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:11.461057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ed732-fe8e-4cd2-9668-f713edbcddee None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:11.461332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ed732-fe8e-4cd2-9668-f713edbcddee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:11.482328 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-527ed732-fe8e-4cd2-9668-f713edbcddee None None] MFA Rules not processed for user `dc59d3cc1fbc4d4382bffd8ae93075e1`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:11.483775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-527ed732-fe8e-4cd2-9668-f713edbcddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:11.543601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1137/2293] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:55:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:55:11.563059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04194b62-10c6-49a6-b71c-eb925b4f99e8 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:11.565119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-04194b62-10c6-49a6-b71c-eb925b4f99e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:11.588166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04194b62-10c6-49a6-b71c-eb925b4f99e8 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:11.592322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530b935-9326-48cc-9246-6fb83a181e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:11.593175 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530b935-9326-48cc-9246-6fb83a181e9a service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:11.593459 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530b935-9326-48cc-9246-6fb83a181e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:11.593735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530b935-9326-48cc-9246-6fb83a181e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:11.601639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530b935-9326-48cc-9246-6fb83a181e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:11.603069 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530b935-9326-48cc-9246-6fb83a181e9a service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:11.613278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1157/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:55:11.710761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756e59-e479-4e02-bc8c-4d1dab7a77ca None None] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:11.711083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756e59-e479-4e02-bc8c-4d1dab7a77ca None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:11.711389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756e59-e479-4e02-bc8c-4d1dab7a77ca None None] PATH_INFO: `/` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:11.712757 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1138/2295] 10.222.0.18 () {54 vars in 921 bytes} [Wed Oct 12 04:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 04:55:11.718830 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe084c0-082f-47aa-bf59-0a7e32988649 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:11.720172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe084c0-082f-47aa-bf59-0a7e32988649 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:11.720454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe084c0-082f-47aa-bf59-0a7e32988649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:11.748024 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-5fe084c0-082f-47aa-bf59-0a7e32988649 None None] MFA Rules not processed for user `7e02bef3699b4569986b36cec686931a`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:11.749485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5fe084c0-082f-47aa-bf59-0a7e32988649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:11.761898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1158/2296] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Oct 12 04:55:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:11.774938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756e59-e479-4e02-bc8c-4d1dab7a77ca None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:11.776741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0c756e59-e479-4e02-bc8c-4d1dab7a77ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:11.794915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756e59-e479-4e02-bc8c-4d1dab7a77ca None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:11.798527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b350b-9c8d-4726-b784-ddbd123c2eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:11.799233 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b350b-9c8d-4726-b784-ddbd123c2eec service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:11.799587 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b350b-9c8d-4726-b784-ddbd123c2eec service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:11.799931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b350b-9c8d-4726-b784-ddbd123c2eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:11.811457 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b350b-9c8d-4726-b784-ddbd123c2eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:11.812887 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b350b-9c8d-4726-b784-ddbd123c2eec service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:11.827049 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1139/2297] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:55:15.742278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ffc39-1b45-4354-ae06-3775358d9d80 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:15.742719 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ffc39-1b45-4354-ae06-3775358d9d80 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:15.742862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ffc39-1b45-4354-ae06-3775358d9d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:15.767799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-0d9ffc39-1b45-4354-ae06-3775358d9d80 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:15.769063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-0d9ffc39-1b45-4354-ae06-3775358d9d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:15.822923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=100 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:15.832969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1159/2298] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:55:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:15.845017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b350b-9c8d-4726-b784-ddbd123c2eec service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:15.846537 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-531b350b-9c8d-4726-b784-ddbd123c2eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:15.922885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b350b-9c8d-4726-b784-ddbd123c2eec service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:15.929230 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c27a0-cc2a-4e9e-a22c-e3d2233cfaae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:15.929841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c27a0-cc2a-4e9e-a22c-e3d2233cfaae service swift] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:15.930124 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c27a0-cc2a-4e9e-a22c-e3d2233cfaae service swift] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:15.930400 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c27a0-cc2a-4e9e-a22c-e3d2233cfaae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:15.939346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c27a0-cc2a-4e9e-a22c-e3d2233cfaae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:15.941201 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c27a0-cc2a-4e9e-a22c-e3d2233cfaae service swift] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:15.951569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1140/2299] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:55:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:55:16.972667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f66744-28c4-475b-8393-fc8d4186b279 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:16.973259 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f66744-28c4-475b-8393-fc8d4186b279 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:16.973259 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f66744-28c4-475b-8393-fc8d4186b279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:16.994581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-65f66744-28c4-475b-8393-fc8d4186b279 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:16.995873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-65f66744-28c4-475b-8393-fc8d4186b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:17.003299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1160/2300] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Oct 12 04:55:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:17.016777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c27a0-cc2a-4e9e-a22c-e3d2233cfaae service swift] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:17.028083 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c27a0-cc2a-4e9e-a22c-e3d2233cfaae service swift] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:17.041388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e9b62-e442-4d28-b6bb-830bbb239cbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:17.042129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e9b62-e442-4d28-b6bb-830bbb239cbe service swift] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:17.042476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e9b62-e442-4d28-b6bb-830bbb239cbe service swift] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:17.042831 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e9b62-e442-4d28-b6bb-830bbb239cbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:17.054975 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e9b62-e442-4d28-b6bb-830bbb239cbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:17.056837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e9b62-e442-4d28-b6bb-830bbb239cbe service swift] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:17.067765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1141/2301] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:55:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:55:26.988980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:27.062350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=87 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:33.871931 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52ead6-6865-4f99-a656-495cd5529259 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:33.872479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52ead6-6865-4f99-a656-495cd5529259 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:33.872479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52ead6-6865-4f99-a656-495cd5529259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:33.897887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-5c52ead6-6865-4f99-a656-495cd5529259 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:33.899388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5c52ead6-6865-4f99-a656-495cd5529259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:33.907395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1161/2302] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 04:55:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:33.927371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e9b62-e442-4d28-b6bb-830bbb239cbe service swift] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:33.940686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e9b62-e442-4d28-b6bb-830bbb239cbe service swift] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:33.950114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6183eb-a6bf-440f-8789-a07ac595d2bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:33.950748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6183eb-a6bf-440f-8789-a07ac595d2bf service swift] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:33.951252 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6183eb-a6bf-440f-8789-a07ac595d2bf service swift] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:33.951773 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6183eb-a6bf-440f-8789-a07ac595d2bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:33.964960 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6183eb-a6bf-440f-8789-a07ac595d2bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:33.969352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6183eb-a6bf-440f-8789-a07ac595d2bf service swift] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:33.982171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1142/2303] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:55:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:55:34.117296 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157f889-d766-4c75-af27-2dc961237896 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:34.117844 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157f889-d766-4c75-af27-2dc961237896 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:34.118307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157f889-d766-4c75-af27-2dc961237896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:34.151911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2157f889-d766-4c75-af27-2dc961237896 None None] MFA Rules not processed for user `91d54c81edf4416488d569bd1377bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:34.153526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2157f889-d766-4c75-af27-2dc961237896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:34.179077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1162/2304] 10.222.0.18 () {58 vars in 967 bytes} [Wed Oct 12 04:55:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:34.200278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6183eb-a6bf-440f-8789-a07ac595d2bf service swift] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:34.214301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6183eb-a6bf-440f-8789-a07ac595d2bf service swift] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:34.227675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35bfb2-3806-4417-b0b9-e6afbf963d01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5efddd82994140a5f07c926375d477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:34.228367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35bfb2-3806-4417-b0b9-e6afbf963d01 service swift] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:34.228654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35bfb2-3806-4417-b0b9-e6afbf963d01 service swift] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:34.228937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35bfb2-3806-4417-b0b9-e6afbf963d01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:34.239503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35bfb2-3806-4417-b0b9-e6afbf963d01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:34.241109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35bfb2-3806-4417-b0b9-e6afbf963d01 service swift] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:34.250447 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1143/2305] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Oct 12 04:55:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 04:55:36.551467 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157f889-d766-4c75-af27-2dc961237896 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:36.552895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2157f889-d766-4c75-af27-2dc961237896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:36.622257 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157f889-d766-4c75-af27-2dc961237896 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:36.627136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:36.627867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:36.628152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:36.628593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] PATH_INFO: `/v3/users/ffbf8d07d4f94256a00a647a66c38e62` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:36.629743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffbf8d07d4f94256a00a647a66c38e62)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:36.631744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:36.685346 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffbf8d07d4f94256a00a647a66c38e62'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:36.692454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffbf8d07d4f94256a00a647a66c38e62'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:36.693151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffbf8d07d4f94256a00a647a66c38e62'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:36.693769 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffbf8d07d4f94256a00a647a66c38e62'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:36.701995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-e79c336b-4e39-4bc5-8ab2-3f980eccd312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffbf8d07d4f94256a00a647a66c38e62'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:36.724444 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1163/2306] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:55:36 2022] DELETE /identity/v3/users/ffbf8d07d4f94256a00a647a66c38e62 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:55:36.903459 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35bfb2-3806-4417-b0b9-e6afbf963d01 service swift] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:36.918757 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35bfb2-3806-4417-b0b9-e6afbf963d01 service swift] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:36.979628 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:36.980345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:36.980711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:36.980964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] PATH_INFO: `/v3/projects/e14b19065d6f44a084590651fc2da894` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:36.982497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14b19065d6f44a084590651fc2da894)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:36.984078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:37.044982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14b19065d6f44a084590651fc2da894', 'request_id': 'req-2892fc7d-d183-4362-a5ec-fd702c796cad'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:37.052623 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14b19065d6f44a084590651fc2da894', 'request_id': 'req-2892fc7d-d183-4362-a5ec-fd702c796cad'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:37.063793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14b19065d6f44a084590651fc2da894', 'request_id': 'req-2892fc7d-d183-4362-a5ec-fd702c796cad'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:37.076257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] The token cache is being invalidate because project e14b19065d6f44a084590651fc2da894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:55:37.076625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:37.078401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2892fc7d-d183-4362-a5ec-fd702c796cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:37.079252 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1144/2307] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:55:36 2022] DELETE /identity/v3/projects/e14b19065d6f44a084590651fc2da894 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:55:37.085390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec89a-fc90-4578-9496-27fc809c0c4d None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:37.085777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec89a-fc90-4578-9496-27fc809c0c4d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:37.086071 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cec89a-fc90-4578-9496-27fc809c0c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:37.108485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-08cec89a-fc90-4578-9496-27fc809c0c4d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:37.109997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-08cec89a-fc90-4578-9496-27fc809c0c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:37.176371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1164/2308] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:37.184829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ee2d0-ddac-4eaa-b97b-2be8634d74b9 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:37.184829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ee2d0-ddac-4eaa-b97b-2be8634d74b9 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:37.185122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ee2d0-ddac-4eaa-b97b-2be8634d74b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:37.206789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-4d7ee2d0-ddac-4eaa-b97b-2be8634d74b9 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:37.208064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-4d7ee2d0-ddac-4eaa-b97b-2be8634d74b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:37.216279 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1145/2309] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:37.220626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec89a-fc90-4578-9496-27fc809c0c4d None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:37.230619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cec89a-fc90-4578-9496-27fc809c0c4d None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:37.235834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76037e3-9027-48f7-a6cf-e9d0872edf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:37.236532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76037e3-9027-48f7-a6cf-e9d0872edf5b admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:37.236822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76037e3-9027-48f7-a6cf-e9d0872edf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:37.237176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76037e3-9027-48f7-a6cf-e9d0872edf5b admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:37.237865 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76037e3-9027-48f7-a6cf-e9d0872edf5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:55:37.238171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76037e3-9027-48f7-a6cf-e9d0872edf5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:37.239823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76037e3-9027-48f7-a6cf-e9d0872edf5b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:37.241418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:37.257753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1165/2310] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:55:37.258903 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ee2d0-ddac-4eaa-b97b-2be8634d74b9 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:37.269509 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ee2d0-ddac-4eaa-b97b-2be8634d74b9 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:37.274283 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6607479-af8e-43a6-a0ec-6d2bb02112f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:37.274894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6607479-af8e-43a6-a0ec-6d2bb02112f2 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:37.275200 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6607479-af8e-43a6-a0ec-6d2bb02112f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:37.275515 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6607479-af8e-43a6-a0ec-6d2bb02112f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:37.276150 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6607479-af8e-43a6-a0ec-6d2bb02112f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:37.278070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6607479-af8e-43a6-a0ec-6d2bb02112f2 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:37.306595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1146/2311] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:55:37 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:55:37.310753 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76037e3-9027-48f7-a6cf-e9d0872edf5b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:37.321313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76037e3-9027-48f7-a6cf-e9d0872edf5b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:37.384186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a7811-7c30-457f-aa59-bbe307695790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:37.384824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a7811-7c30-457f-aa59-bbe307695790 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:37.386330 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a7811-7c30-457f-aa59-bbe307695790 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:37.386698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a7811-7c30-457f-aa59-bbe307695790 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:37.387381 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a7811-7c30-457f-aa59-bbe307695790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:37.389315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a7811-7c30-457f-aa59-bbe307695790 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:37.415377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1166/2312] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:55:37 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:55:37.416673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6607479-af8e-43a6-a0ec-6d2bb02112f2 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:37.427984 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6607479-af8e-43a6-a0ec-6d2bb02112f2 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:37.432919 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3089e3f-22dc-4ef0-a03f-d66ba3fcaece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:37.433528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089e3f-22dc-4ef0-a03f-d66ba3fcaece admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:37.433814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089e3f-22dc-4ef0-a03f-d66ba3fcaece admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:37.434209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089e3f-22dc-4ef0-a03f-d66ba3fcaece admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:37.434857 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3089e3f-22dc-4ef0-a03f-d66ba3fcaece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:37.436529 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3089e3f-22dc-4ef0-a03f-d66ba3fcaece admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:37.447804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1147/2313] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:55:37.452078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a7811-7c30-457f-aa59-bbe307695790 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:37.462873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a7811-7c30-457f-aa59-bbe307695790 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:37.468093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ba455-b90a-4ff0-9dcb-2282eebfa25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:37.468705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ba455-b90a-4ff0-9dcb-2282eebfa25c admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:37.469227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ba455-b90a-4ff0-9dcb-2282eebfa25c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:37.469513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ba455-b90a-4ff0-9dcb-2282eebfa25c admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:37.470156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ba455-b90a-4ff0-9dcb-2282eebfa25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:37.472397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ba455-b90a-4ff0-9dcb-2282eebfa25c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:37.483776 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1167/2314] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:55:37.488089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3089e3f-22dc-4ef0-a03f-d66ba3fcaece admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:37.498601 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3089e3f-22dc-4ef0-a03f-d66ba3fcaece admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:37.504533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0eeb03-1080-4f42-8c0f-78ed26392a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:37.505303 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0eeb03-1080-4f42-8c0f-78ed26392a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:37.505658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0eeb03-1080-4f42-8c0f-78ed26392a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:37.506010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0eeb03-1080-4f42-8c0f-78ed26392a32 admin admin] PATH_INFO: `/v3/projects/843bb6c6f8044dfda25c97b0e681110b/users/88a01b0e54bd482190dca601fc1edd4e/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:37.524104 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0eeb03-1080-4f42-8c0f-78ed26392a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843bb6c6f8044dfda25c97b0e681110b, user_id=88a01b0e54bd482190dca601fc1edd4e, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:37.527422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0eeb03-1080-4f42-8c0f-78ed26392a32 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:37.537431 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:37.543167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1148/2315] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:55:37 2022] PUT /identity/v3/projects/843bb6c6f8044dfda25c97b0e681110b/users/88a01b0e54bd482190dca601fc1edd4e/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:55:37.557133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772db04-9870-427d-95d0-0db01ff0702c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:37.557133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772db04-9870-427d-95d0-0db01ff0702c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:37.557133 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772db04-9870-427d-95d0-0db01ff0702c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:37.591795 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-a772db04-9870-427d-95d0-0db01ff0702c None None] MFA Rules not processed for user `88a01b0e54bd482190dca601fc1edd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:37.593038 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a772db04-9870-427d-95d0-0db01ff0702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:37.678993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1168/2316] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:55:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:37.694138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0eeb03-1080-4f42-8c0f-78ed26392a32 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:37.695872 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1b0eeb03-1080-4f42-8c0f-78ed26392a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:37.752683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0eeb03-1080-4f42-8c0f-78ed26392a32 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:37.756346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7daf33-0476-4d2a-b03e-2df6895012e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c894579b2b2943409412afbbfe779aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:37.756947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7daf33-0476-4d2a-b03e-2df6895012e8 service glance] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:37.757225 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7daf33-0476-4d2a-b03e-2df6895012e8 service glance] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:37.757497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7daf33-0476-4d2a-b03e-2df6895012e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:37.765705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7daf33-0476-4d2a-b03e-2df6895012e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:37.767129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7daf33-0476-4d2a-b03e-2df6895012e8 service glance] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:37.776540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1149/2317] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:55:40.612151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772db04-9870-427d-95d0-0db01ff0702c None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:40.613648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a772db04-9870-427d-95d0-0db01ff0702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:40.678623 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772db04-9870-427d-95d0-0db01ff0702c None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:40.682548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9542aca-9ebf-4f4b-80aa-26046b233e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:40.683196 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9542aca-9ebf-4f4b-80aa-26046b233e0b service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:40.683550 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9542aca-9ebf-4f4b-80aa-26046b233e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:40.683826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9542aca-9ebf-4f4b-80aa-26046b233e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:40.685696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f9542aca-9ebf-4f4b-80aa-26046b233e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:40.700095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:40.759556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9542aca-9ebf-4f4b-80aa-26046b233e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:40.760995 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9542aca-9ebf-4f4b-80aa-26046b233e0b service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:40.772033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1169/2318] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:55:44.353754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7daf33-0476-4d2a-b03e-2df6895012e8 service glance] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:44.355210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5e7daf33-0476-4d2a-b03e-2df6895012e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:44.369410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7daf33-0476-4d2a-b03e-2df6895012e8 service glance] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:44.374204 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:44.374832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:44.375115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:44.375426 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] PATH_INFO: `/v3/users/beff795898ae42ae8ca96c3ccc00a31f` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:44.376557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beff795898ae42ae8ca96c3ccc00a31f)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:44.378481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:44.427904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beff795898ae42ae8ca96c3ccc00a31f'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:44.434869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beff795898ae42ae8ca96c3ccc00a31f'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:44.435561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beff795898ae42ae8ca96c3ccc00a31f'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:44.436179 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beff795898ae42ae8ca96c3ccc00a31f'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:44.443273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2a2b81b7-c60a-4c17-9b31-5b99423b7e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beff795898ae42ae8ca96c3ccc00a31f'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:44.461393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1150/2319] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:55:44 2022] DELETE /identity/v3/users/beff795898ae42ae8ca96c3ccc00a31f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:55:44.649062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9542aca-9ebf-4f4b-80aa-26046b233e0b service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:44.659544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9542aca-9ebf-4f4b-80aa-26046b233e0b service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:44.726002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:44.726002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:44.726362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:44.726601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] PATH_INFO: `/v3/projects/ce1c1d48b29a4e03ac03aac2ebaf0c57` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:44.727668 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1c1d48b29a4e03ac03aac2ebaf0c57)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:44.729672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:44.780959 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1c1d48b29a4e03ac03aac2ebaf0c57', 'request_id': 'req-52cabaf7-25e3-4c9f-8a40-764e514bb552'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:44.789816 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1c1d48b29a4e03ac03aac2ebaf0c57', 'request_id': 'req-52cabaf7-25e3-4c9f-8a40-764e514bb552'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:44.798143 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1c1d48b29a4e03ac03aac2ebaf0c57', 'request_id': 'req-52cabaf7-25e3-4c9f-8a40-764e514bb552'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:44.809804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] The token cache is being invalidate because project ce1c1d48b29a4e03ac03aac2ebaf0c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:55:44.810248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:44.810919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-52cabaf7-25e3-4c9f-8a40-764e514bb552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:44.816486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1170/2320] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:55:44 2022] DELETE /identity/v3/projects/ce1c1d48b29a4e03ac03aac2ebaf0c57 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:55:44.821366 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e97fb-66c2-40d2-9dda-3adbfd73e843 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:44.821366 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e97fb-66c2-40d2-9dda-3adbfd73e843 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:44.821366 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e97fb-66c2-40d2-9dda-3adbfd73e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:44.845885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-f92e97fb-66c2-40d2-9dda-3adbfd73e843 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:44.847410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-f92e97fb-66c2-40d2-9dda-3adbfd73e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:44.919692 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1151/2321] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:44.928091 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b2412-ad7a-4084-95df-a6651e01f326 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:44.928380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b2412-ad7a-4084-95df-a6651e01f326 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:44.928658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b2412-ad7a-4084-95df-a6651e01f326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:44.953625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-ee8b2412-ad7a-4084-95df-a6651e01f326 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:44.954847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ee8b2412-ad7a-4084-95df-a6651e01f326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:44.963722 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1171/2322] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:44.968012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e97fb-66c2-40d2-9dda-3adbfd73e843 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:44.978449 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e97fb-66c2-40d2-9dda-3adbfd73e843 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:44.989140 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2266a-5206-4625-8583-63e9ac2367c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:44.989775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2266a-5206-4625-8583-63e9ac2367c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:44.990059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2266a-5206-4625-8583-63e9ac2367c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:44.990337 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2266a-5206-4625-8583-63e9ac2367c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:44.991001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2266a-5206-4625-8583-63e9ac2367c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:55:44.991336 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2266a-5206-4625-8583-63e9ac2367c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:44.992986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2266a-5206-4625-8583-63e9ac2367c7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:45.005080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1152/2323] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:55:45.009461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b2412-ad7a-4084-95df-a6651e01f326 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:45.019136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b2412-ad7a-4084-95df-a6651e01f326 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:45.023853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188762f-330f-4038-b4c5-5e9c3eab8062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:45.024452 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188762f-330f-4038-b4c5-5e9c3eab8062 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:45.024737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188762f-330f-4038-b4c5-5e9c3eab8062 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:45.025015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188762f-330f-4038-b4c5-5e9c3eab8062 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:45.025649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188762f-330f-4038-b4c5-5e9c3eab8062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:45.027598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188762f-330f-4038-b4c5-5e9c3eab8062 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:45.083272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1172/2324] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:55:45 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:55:45.087641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2266a-5206-4625-8583-63e9ac2367c7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:45.092949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:45.099348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2266a-5206-4625-8583-63e9ac2367c7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:45.160738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67961c9e-e180-4068-802d-bcde5d582025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:45.161349 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67961c9e-e180-4068-802d-bcde5d582025 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:45.161634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67961c9e-e180-4068-802d-bcde5d582025 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:45.161912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67961c9e-e180-4068-802d-bcde5d582025 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:45.162599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67961c9e-e180-4068-802d-bcde5d582025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:45.164568 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67961c9e-e180-4068-802d-bcde5d582025 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:45.186445 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1153/2325] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:55:45 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:55:45.190711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188762f-330f-4038-b4c5-5e9c3eab8062 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:45.201960 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188762f-330f-4038-b4c5-5e9c3eab8062 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:45.207827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342aed5-df08-4c43-b6d7-0be2aaf9b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:45.208437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342aed5-df08-4c43-b6d7-0be2aaf9b3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:45.208723 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342aed5-df08-4c43-b6d7-0be2aaf9b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:45.209003 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342aed5-df08-4c43-b6d7-0be2aaf9b3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:45.209646 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342aed5-df08-4c43-b6d7-0be2aaf9b3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:45.211294 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342aed5-df08-4c43-b6d7-0be2aaf9b3d1 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:45.221294 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1173/2326] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:55:45.227180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67961c9e-e180-4068-802d-bcde5d582025 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:45.242440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67961c9e-e180-4068-802d-bcde5d582025 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:45.248339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99808be6-85b2-4f90-b552-f7f826fb4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:45.249110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99808be6-85b2-4f90-b552-f7f826fb4078 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:45.249402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99808be6-85b2-4f90-b552-f7f826fb4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:45.249820 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99808be6-85b2-4f90-b552-f7f826fb4078 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:45.250645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99808be6-85b2-4f90-b552-f7f826fb4078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:45.252590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99808be6-85b2-4f90-b552-f7f826fb4078 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:45.280585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1154/2327] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:55:45.282098 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342aed5-df08-4c43-b6d7-0be2aaf9b3d1 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:45.288512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:45.296276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342aed5-df08-4c43-b6d7-0be2aaf9b3d1 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:45.303034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880167e-0aa3-46f7-aa07-138dcf29a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:45.303808 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880167e-0aa3-46f7-aa07-138dcf29a6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:45.304172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880167e-0aa3-46f7-aa07-138dcf29a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:45.304483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880167e-0aa3-46f7-aa07-138dcf29a6f5 admin admin] PATH_INFO: `/v3/projects/8aa6b631b12c40c69931fe88018ff0a1/users/1d278036e95542b38a80150c6fce26a3/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:45.323412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880167e-0aa3-46f7-aa07-138dcf29a6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa6b631b12c40c69931fe88018ff0a1, user_id=1d278036e95542b38a80150c6fce26a3, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:45.326277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880167e-0aa3-46f7-aa07-138dcf29a6f5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:45.359051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1174/2328] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:55:45 2022] PUT /identity/v3/projects/8aa6b631b12c40c69931fe88018ff0a1/users/1d278036e95542b38a80150c6fce26a3/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:55:45.367716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b268f7-e5f2-458c-ac94-4782d5a426fc None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:45.368133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b268f7-e5f2-458c-ac94-4782d5a426fc None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:45.368847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b268f7-e5f2-458c-ac94-4782d5a426fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:45.389391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-80b268f7-e5f2-458c-ac94-4782d5a426fc None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:45.390821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-80b268f7-e5f2-458c-ac94-4782d5a426fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:45.456804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1155/2329] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:45.466755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880167e-0aa3-46f7-aa07-138dcf29a6f5 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:45.468852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2880167e-0aa3-46f7-aa07-138dcf29a6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:45.530212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880167e-0aa3-46f7-aa07-138dcf29a6f5 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:45.534443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251fe42-1cb9-4dfe-a2e1-081aa7b44a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:45.535166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251fe42-1cb9-4dfe-a2e1-081aa7b44a70 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:45.535402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251fe42-1cb9-4dfe-a2e1-081aa7b44a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:45.535714 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251fe42-1cb9-4dfe-a2e1-081aa7b44a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:45.548269 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251fe42-1cb9-4dfe-a2e1-081aa7b44a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:45.549745 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251fe42-1cb9-4dfe-a2e1-081aa7b44a70 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:45.559108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1175/2330] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:55:49.824389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ddde3-67c8-4261-8498-f536cf783874 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:49.824901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ddde3-67c8-4261-8498-f536cf783874 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:49.824995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ddde3-67c8-4261-8498-f536cf783874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:49.868325 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0f5ddde3-67c8-4261-8498-f536cf783874 None None] MFA Rules not processed for user `1d278036e95542b38a80150c6fce26a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:49.869867 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0f5ddde3-67c8-4261-8498-f536cf783874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:49.969424 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1156/2331] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:55:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:49.984783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251fe42-1cb9-4dfe-a2e1-081aa7b44a70 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:49.986281 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8251fe42-1cb9-4dfe-a2e1-081aa7b44a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:50.075170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251fe42-1cb9-4dfe-a2e1-081aa7b44a70 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:50.081074 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b7e8e-4b60-4aab-916b-e3703dcb98cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:50.081681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7e8e-4b60-4aab-916b-e3703dcb98cc service nova] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:50.081957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7e8e-4b60-4aab-916b-e3703dcb98cc service nova] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:50.082227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b7e8e-4b60-4aab-916b-e3703dcb98cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:50.090868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b7e8e-4b60-4aab-916b-e3703dcb98cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:50.092511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b7e8e-4b60-4aab-916b-e3703dcb98cc service nova] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:50.102361 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1176/2332] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:55:51.400689 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62578401-d1a7-4244-ae43-a63308616e45 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:51.401181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62578401-d1a7-4244-ae43-a63308616e45 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:51.401278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62578401-d1a7-4244-ae43-a63308616e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:51.420092 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-62578401-d1a7-4244-ae43-a63308616e45 None None] MFA Rules not processed for user `1d278036e95542b38a80150c6fce26a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:51.421210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-62578401-d1a7-4244-ae43-a63308616e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:51.428655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1157/2333] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:55:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:59.556353 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b7e8e-4b60-4aab-916b-e3703dcb98cc service nova] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:59.557810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-667b7e8e-4b60-4aab-916b-e3703dcb98cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:59.571827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b7e8e-4b60-4aab-916b-e3703dcb98cc service nova] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:59.576626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:59.577247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:59.577527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:59.577906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] PATH_INFO: `/v3/users/88a01b0e54bd482190dca601fc1edd4e` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:59.579045 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a01b0e54bd482190dca601fc1edd4e)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:59.581599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:59.627015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a01b0e54bd482190dca601fc1edd4e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:59.633775 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a01b0e54bd482190dca601fc1edd4e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:59.634435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a01b0e54bd482190dca601fc1edd4e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:59.635061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a01b0e54bd482190dca601fc1edd4e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:59.638602 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:59.643619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a01b0e54bd482190dca601fc1edd4e'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:55:59.663393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1177/2334] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:55:59 2022] DELETE /identity/v3/users/88a01b0e54bd482190dca601fc1edd4e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:55:59.667962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff0860-de31-4682-a8b0-2a511f0c3fd3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:59.668440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff0860-de31-4682-a8b0-2a511f0c3fd3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:59.668557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff0860-de31-4682-a8b0-2a511f0c3fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:59.677128 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:55:59.688551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-99ff0860-de31-4682-a8b0-2a511f0c3fd3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:55:59.689761 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-99ff0860-de31-4682-a8b0-2a511f0c3fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:59.747349 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1158/2335] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:55:59.757190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:55:59.758708 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:55:59.816485 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28112782-38f7-406c-bc79-f4f6f3ffbfe2 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:55:59.820198 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f526-558e-4b66-84b5-ee5ff26b8239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:55:59.820810 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f526-558e-4b66-84b5-ee5ff26b8239 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:55:59.821093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f526-558e-4b66-84b5-ee5ff26b8239 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:55:59.821368 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f526-558e-4b66-84b5-ee5ff26b8239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:55:59.830578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526f526-558e-4b66-84b5-ee5ff26b8239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:55:59.832039 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526f526-558e-4b66-84b5-ee5ff26b8239 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:55:59.841512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1178/2336] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:00.114247 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff0860-de31-4682-a8b0-2a511f0c3fd3 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:00.115733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-99ff0860-de31-4682-a8b0-2a511f0c3fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:00.127607 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff0860-de31-4682-a8b0-2a511f0c3fd3 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:00.132465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:00.133104 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:00.133421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:00.133697 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] PATH_INFO: `/v3/projects/843bb6c6f8044dfda25c97b0e681110b` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:00.134819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843bb6c6f8044dfda25c97b0e681110b)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:00.136771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:00.183315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843bb6c6f8044dfda25c97b0e681110b', 'request_id': 'req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:00.189466 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843bb6c6f8044dfda25c97b0e681110b', 'request_id': 'req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:00.198164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843bb6c6f8044dfda25c97b0e681110b', 'request_id': 'req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:00.212629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] The token cache is being invalidate because project 843bb6c6f8044dfda25c97b0e681110b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:00.212747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:00.213480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:00.215002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1159/2337] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:00 2022] DELETE /identity/v3/projects/843bb6c6f8044dfda25c97b0e681110b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:09.837223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=34,keystone:DELETE=2 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:10.208994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:15.352816 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f526-558e-4b66-84b5-ee5ff26b8239 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:15.354228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9526f526-558e-4b66-84b5-ee5ff26b8239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:15.365970 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f526-558e-4b66-84b5-ee5ff26b8239 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:15.414690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cee63-0661-4a89-9d4c-32772838a93c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:15.415307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cee63-0661-4a89-9d4c-32772838a93c service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:15.415607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cee63-0661-4a89-9d4c-32772838a93c service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:15.415884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cee63-0661-4a89-9d4c-32772838a93c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:15.417594 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f43cee63-0661-4a89-9d4c-32772838a93c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:15.478010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cee63-0661-4a89-9d4c-32772838a93c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:15.479472 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cee63-0661-4a89-9d4c-32772838a93c service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:15.489532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1179/2338] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:18.420464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:18.422056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:18.483051 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cee63-0661-4a89-9d4c-32772838a93c service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:18.484882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f43cee63-0661-4a89-9d4c-32772838a93c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:18.498164 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cee63-0661-4a89-9d4c-32772838a93c service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:18.504430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:18.505205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:18.505585 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:18.506007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] PATH_INFO: `/v3/users/b3afb5c7305d4162b32e57385d949af6` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:18.507466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3afb5c7305d4162b32e57385d949af6)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:18.509494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:18.518719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aca1ca-686a-47c6-875c-77ef9a86f6d0 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:18.523458 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c214d-2fac-47cd-99f9-0931fc0569e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:18.524072 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c214d-2fac-47cd-99f9-0931fc0569e6 service placement] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:18.524359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c214d-2fac-47cd-99f9-0931fc0569e6 service placement] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:18.524636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c214d-2fac-47cd-99f9-0931fc0569e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:18.526432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-382c214d-2fac-47cd-99f9-0931fc0569e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:18.540452 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c214d-2fac-47cd-99f9-0931fc0569e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:18.542014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c214d-2fac-47cd-99f9-0931fc0569e6 service placement] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:18.553832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1160/2339] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:18.571782 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3afb5c7305d4162b32e57385d949af6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:18.583943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3afb5c7305d4162b32e57385d949af6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:18.584721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3afb5c7305d4162b32e57385d949af6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:18.585717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3afb5c7305d4162b32e57385d949af6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:18.594909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-84117942-1234-4caf-9636-423213f3a399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3afb5c7305d4162b32e57385d949af6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:18.614057 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1180/2340] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:56:18 2022] DELETE /identity/v3/users/b3afb5c7305d4162b32e57385d949af6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:56:18.789264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c214d-2fac-47cd-99f9-0931fc0569e6 service placement] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:18.801564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c214d-2fac-47cd-99f9-0931fc0569e6 service placement] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:18.860450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:18.861111 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:18.861397 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:18.861671 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] PATH_INFO: `/v3/projects/a5cb91358b814419be8b1e7e73691e7f` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:18.862792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5cb91358b814419be8b1e7e73691e7f)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:18.864714 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:18.909869 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5cb91358b814419be8b1e7e73691e7f', 'request_id': 'req-f5a7bc18-7625-440c-937a-6264f641c2fb'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:18.915953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5cb91358b814419be8b1e7e73691e7f', 'request_id': 'req-f5a7bc18-7625-440c-937a-6264f641c2fb'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:18.922923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5cb91358b814419be8b1e7e73691e7f', 'request_id': 'req-f5a7bc18-7625-440c-937a-6264f641c2fb'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:18.932915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] The token cache is being invalidate because project a5cb91358b814419be8b1e7e73691e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:18.933202 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:18.933821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-f5a7bc18-7625-440c-937a-6264f641c2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:18.935302 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1161/2341] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:18 2022] DELETE /identity/v3/projects/a5cb91358b814419be8b1e7e73691e7f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:18.940229 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59d10-4193-425e-ac81-0977e2b6832e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:18.940517 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59d10-4193-425e-ac81-0977e2b6832e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:18.940796 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59d10-4193-425e-ac81-0977e2b6832e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:18.961911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-6ce59d10-4193-425e-ac81-0977e2b6832e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:18.963237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-6ce59d10-4193-425e-ac81-0977e2b6832e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:18.979787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:19.023025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1181/2342] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:19.030906 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa455a-0524-45c9-915d-11b2b185172e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.031191 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa455a-0524-45c9-915d-11b2b185172e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.031558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa455a-0524-45c9-915d-11b2b185172e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.052234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-38fa455a-0524-45c9-915d-11b2b185172e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:19.053420 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-38fa455a-0524-45c9-915d-11b2b185172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:19.061129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1162/2343] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:19.065786 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce59d10-4193-425e-ac81-0977e2b6832e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.075346 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce59d10-4193-425e-ac81-0977e2b6832e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.080750 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4884-c240-4d6d-af4a-65781c7c78f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.081348 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4884-c240-4d6d-af4a-65781c7c78f2 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.081631 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4884-c240-4d6d-af4a-65781c7c78f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.081906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4884-c240-4d6d-af4a-65781c7c78f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.082544 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc4884-c240-4d6d-af4a-65781c7c78f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:56:19.082849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc4884-c240-4d6d-af4a-65781c7c78f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.084474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc4884-c240-4d6d-af4a-65781c7c78f2 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.095865 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1182/2344] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:56:19.100002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa455a-0524-45c9-915d-11b2b185172e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.109078 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa455a-0524-45c9-915d-11b2b185172e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.113738 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734a9d6-33c5-4784-a990-42653d8241d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.114326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734a9d6-33c5-4784-a990-42653d8241d7 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.114611 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734a9d6-33c5-4784-a990-42653d8241d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.114889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734a9d6-33c5-4784-a990-42653d8241d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.115564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734a9d6-33c5-4784-a990-42653d8241d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.117446 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734a9d6-33c5-4784-a990-42653d8241d7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.128868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:19.147364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1163/2345] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:56:19 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:19.151668 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4884-c240-4d6d-af4a-65781c7c78f2 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.161491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4884-c240-4d6d-af4a-65781c7c78f2 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.216622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f370e-c974-4702-ab15-91eedb9fa1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.217218 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f370e-c974-4702-ab15-91eedb9fa1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.217497 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f370e-c974-4702-ab15-91eedb9fa1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.217770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f370e-c974-4702-ab15-91eedb9fa1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.218388 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f370e-c974-4702-ab15-91eedb9fa1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.220317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f370e-c974-4702-ab15-91eedb9fa1d3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.241613 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1183/2346] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:56:19 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:19.246110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734a9d6-33c5-4784-a990-42653d8241d7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.256815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734a9d6-33c5-4784-a990-42653d8241d7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.261471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f797d1-064f-4e57-acda-6e822067df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.262070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f797d1-064f-4e57-acda-6e822067df12 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.262355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f797d1-064f-4e57-acda-6e822067df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.262631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f797d1-064f-4e57-acda-6e822067df12 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.263264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f797d1-064f-4e57-acda-6e822067df12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.264875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f797d1-064f-4e57-acda-6e822067df12 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.274848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1164/2347] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:19.278600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f370e-c974-4702-ab15-91eedb9fa1d3 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.289140 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f370e-c974-4702-ab15-91eedb9fa1d3 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.293833 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefbbce-0375-4910-b5a2-28898fe98371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.294428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbbce-0375-4910-b5a2-28898fe98371 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.294713 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbbce-0375-4910-b5a2-28898fe98371 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.294988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbbce-0375-4910-b5a2-28898fe98371 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.295665 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefbbce-0375-4910-b5a2-28898fe98371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.297278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefbbce-0375-4910-b5a2-28898fe98371 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.307748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1184/2348] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:19.311706 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f797d1-064f-4e57-acda-6e822067df12 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.322474 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f797d1-064f-4e57-acda-6e822067df12 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.327356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f544dd-60ad-4361-be6c-e20ffe1dc07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.328005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f544dd-60ad-4361-be6c-e20ffe1dc07f admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.328290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f544dd-60ad-4361-be6c-e20ffe1dc07f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.328565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f544dd-60ad-4361-be6c-e20ffe1dc07f admin admin] PATH_INFO: `/v3/projects/b6ab2924cb9f4b74917bec3c2a8276d6/users/45bec648339b47ebab319ca6193c1f73/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.342996 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f544dd-60ad-4361-be6c-e20ffe1dc07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ab2924cb9f4b74917bec3c2a8276d6, user_id=45bec648339b47ebab319ca6193c1f73, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.346163 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f544dd-60ad-4361-be6c-e20ffe1dc07f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.358926 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1165/2349] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:19 2022] PUT /identity/v3/projects/b6ab2924cb9f4b74917bec3c2a8276d6/users/45bec648339b47ebab319ca6193c1f73/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:19.369672 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fd39-5742-4d8e-958c-fc93b4f8e6ea None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.369958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fd39-5742-4d8e-958c-fc93b4f8e6ea None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.370233 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fd39-5742-4d8e-958c-fc93b4f8e6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.397411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-38f8fd39-5742-4d8e-958c-fc93b4f8e6ea None None] MFA Rules not processed for user `45bec648339b47ebab319ca6193c1f73`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:19.398597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-38f8fd39-5742-4d8e-958c-fc93b4f8e6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:19.460392 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1185/2350] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:19.464839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f544dd-60ad-4361-be6c-e20ffe1dc07f admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.524563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f544dd-60ad-4361-be6c-e20ffe1dc07f admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.529241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a8e8-2f30-450a-9136-80b3915d11b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.529838 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a8e8-2f30-450a-9136-80b3915d11b1 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.530120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a8e8-2f30-450a-9136-80b3915d11b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.530396 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a8e8-2f30-450a-9136-80b3915d11b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.531021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6a8e8-2f30-450a-9136-80b3915d11b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.533510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6a8e8-2f30-450a-9136-80b3915d11b1 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.559936 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1166/2351] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:56:19 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:56:19.563859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fd39-5742-4d8e-958c-fc93b4f8e6ea None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.575173 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fd39-5742-4d8e-958c-fc93b4f8e6ea None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.587815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:19.631512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f145f-c710-40fd-bbaa-48bda2c961ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.632121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f145f-c710-40fd-bbaa-48bda2c961ba admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.632405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f145f-c710-40fd-bbaa-48bda2c961ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.632683 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f145f-c710-40fd-bbaa-48bda2c961ba admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.633315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f145f-c710-40fd-bbaa-48bda2c961ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.635220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f145f-c710-40fd-bbaa-48bda2c961ba admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.656328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1186/2352] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:56:19 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:19.660804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a8e8-2f30-450a-9136-80b3915d11b1 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.670758 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a8e8-2f30-450a-9136-80b3915d11b1 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.676345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf63e81-bc9e-45f9-9182-be7eb4796dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.676944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63e81-bc9e-45f9-9182-be7eb4796dfd admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.677224 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63e81-bc9e-45f9-9182-be7eb4796dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.677512 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63e81-bc9e-45f9-9182-be7eb4796dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.678138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf63e81-bc9e-45f9-9182-be7eb4796dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.679746 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf63e81-bc9e-45f9-9182-be7eb4796dfd admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.690484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1167/2353] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:19.694436 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f145f-c710-40fd-bbaa-48bda2c961ba admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.704976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f145f-c710-40fd-bbaa-48bda2c961ba admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.709735 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4cfc-9ffe-4707-888b-5b4d7731364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.710412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4cfc-9ffe-4707-888b-5b4d7731364b admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.710694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4cfc-9ffe-4707-888b-5b4d7731364b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.710972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4cfc-9ffe-4707-888b-5b4d7731364b admin admin] PATH_INFO: `/v3/projects/53baf59d6c514425bd1f4ef5470c6172/users/3c524d1859304c39ab89a4b0ab86995d/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.725619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d4cfc-9ffe-4707-888b-5b4d7731364b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53baf59d6c514425bd1f4ef5470c6172, user_id=3c524d1859304c39ab89a4b0ab86995d, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.728326 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d4cfc-9ffe-4707-888b-5b4d7731364b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.741580 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1187/2354] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:19 2022] PUT /identity/v3/projects/53baf59d6c514425bd1f4ef5470c6172/users/3c524d1859304c39ab89a4b0ab86995d/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:56:19.745710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf63e81-bc9e-45f9-9182-be7eb4796dfd admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.756070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf63e81-bc9e-45f9-9182-be7eb4796dfd admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.810641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d52a4-7deb-4921-bead-dcbc6a07df00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.811173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d52a4-7deb-4921-bead-dcbc6a07df00 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.811480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d52a4-7deb-4921-bead-dcbc6a07df00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.811754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d52a4-7deb-4921-bead-dcbc6a07df00 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.812380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d52a4-7deb-4921-bead-dcbc6a07df00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.813990 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d52a4-7deb-4921-bead-dcbc6a07df00 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.823246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1168/2355] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:19.827664 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4cfc-9ffe-4707-888b-5b4d7731364b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.838008 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4cfc-9ffe-4707-888b-5b4d7731364b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:19.843087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3ad3-e359-4d0c-a2a4-c85036e6de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:19.843813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3ad3-e359-4d0c-a2a4-c85036e6de0c admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.844078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3ad3-e359-4d0c-a2a4-c85036e6de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.844349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3ad3-e359-4d0c-a2a4-c85036e6de0c admin admin] PATH_INFO: `/v3/projects/53baf59d6c514425bd1f4ef5470c6172/users/3c524d1859304c39ab89a4b0ab86995d/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.846754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff3ad3-e359-4d0c-a2a4-c85036e6de0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53baf59d6c514425bd1f4ef5470c6172, user_id=3c524d1859304c39ab89a4b0ab86995d, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:19.849681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff3ad3-e359-4d0c-a2a4-c85036e6de0c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:19.860483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1188/2356] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:19 2022] PUT /identity/v3/projects/53baf59d6c514425bd1f4ef5470c6172/users/3c524d1859304c39ab89a4b0ab86995d/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:19.872633 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24738b-455b-447e-bc6a-fc301fa082cf None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:19.872925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24738b-455b-447e-bc6a-fc301fa082cf None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:19.873206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24738b-455b-447e-bc6a-fc301fa082cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:19.902134 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-bd24738b-455b-447e-bc6a-fc301fa082cf None None] MFA Rules not processed for user `3c524d1859304c39ab89a4b0ab86995d`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:19.903638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bd24738b-455b-447e-bc6a-fc301fa082cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:19.916980 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:19.976600 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1169/2357] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:19.988528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3ad3-e359-4d0c-a2a4-c85036e6de0c admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:19.990242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-aeff3ad3-e359-4d0c-a2a4-c85036e6de0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:20.048980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3ad3-e359-4d0c-a2a4-c85036e6de0c admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:20.052652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59685369-f88e-423e-85de-2932570ef89e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:20.053250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59685369-f88e-423e-85de-2932570ef89e service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:20.053533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59685369-f88e-423e-85de-2932570ef89e service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:20.053813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59685369-f88e-423e-85de-2932570ef89e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:20.062649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59685369-f88e-423e-85de-2932570ef89e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:20.064052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59685369-f88e-423e-85de-2932570ef89e service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:20.073334 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1189/2358] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:20.145861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24738b-455b-447e-bc6a-fc301fa082cf None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:20.155672 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24738b-455b-447e-bc6a-fc301fa082cf None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:20.159907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de43a28-f895-4b8f-aa86-b54e1c6c40ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:20.160508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de43a28-f895-4b8f-aa86-b54e1c6c40ea service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:20.160790 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de43a28-f895-4b8f-aa86-b54e1c6c40ea service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:20.161062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de43a28-f895-4b8f-aa86-b54e1c6c40ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:20.219236 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de43a28-f895-4b8f-aa86-b54e1c6c40ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:20.221349 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de43a28-f895-4b8f-aa86-b54e1c6c40ea service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:20.230287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1170/2359] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:26.966948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59685369-f88e-423e-85de-2932570ef89e service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:27.027149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59685369-f88e-423e-85de-2932570ef89e service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:27.031797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:27.032420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:27.032701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:27.032976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] PATH_INFO: `/v3/users/45bec648339b47ebab319ca6193c1f73` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:27.034086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bec648339b47ebab319ca6193c1f73)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:27.036055 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:27.049414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:27.084325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bec648339b47ebab319ca6193c1f73'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.090928 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bec648339b47ebab319ca6193c1f73'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.091600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bec648339b47ebab319ca6193c1f73'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.092212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bec648339b47ebab319ca6193c1f73'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.099523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bec648339b47ebab319ca6193c1f73'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.117104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1190/2360] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:56:26 2022] DELETE /identity/v3/users/45bec648339b47ebab319ca6193c1f73 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:27.121531 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100e72-05e2-4524-b7e0-1dbcc77c2986 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:27.122011 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100e72-05e2-4524-b7e0-1dbcc77c2986 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:27.122119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100e72-05e2-4524-b7e0-1dbcc77c2986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:27.141120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ff100e72-05e2-4524-b7e0-1dbcc77c2986 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:27.142301 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ff100e72-05e2-4524-b7e0-1dbcc77c2986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:27.199857 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1171/2361] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:27.209680 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:27.211090 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:27.266761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b76357-e07f-4e7b-8dfb-cb8114b64ac1 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:27.270433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57e743-f099-4a6c-88cf-82486818bc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:27.271032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57e743-f099-4a6c-88cf-82486818bc55 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:27.271342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57e743-f099-4a6c-88cf-82486818bc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:27.271623 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57e743-f099-4a6c-88cf-82486818bc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:27.280482 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57e743-f099-4a6c-88cf-82486818bc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:27.281908 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57e743-f099-4a6c-88cf-82486818bc55 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:27.291698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1191/2362] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:27.549483 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff100e72-05e2-4524-b7e0-1dbcc77c2986 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:27.551098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ff100e72-05e2-4524-b7e0-1dbcc77c2986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:27.568416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff100e72-05e2-4524-b7e0-1dbcc77c2986 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:27.573289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:27.573923 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:27.574210 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:27.574488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] PATH_INFO: `/v3/projects/b6ab2924cb9f4b74917bec3c2a8276d6` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:27.575939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ab2924cb9f4b74917bec3c2a8276d6)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:27.578175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:27.622784 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:27.625906 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ab2924cb9f4b74917bec3c2a8276d6', 'request_id': 'req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.632788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ab2924cb9f4b74917bec3c2a8276d6', 'request_id': 'req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.639625 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ab2924cb9f4b74917bec3c2a8276d6', 'request_id': 'req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.649888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] The token cache is being invalidate because project b6ab2924cb9f4b74917bec3c2a8276d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:27.650189 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.650818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.652336 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1172/2363] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:27 2022] DELETE /identity/v3/projects/b6ab2924cb9f4b74917bec3c2a8276d6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:27.656772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57e743-f099-4a6c-88cf-82486818bc55 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:27.666848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57e743-f099-4a6c-88cf-82486818bc55 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:27.723799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:27.724460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:27.724742 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:27.725018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] PATH_INFO: `/v3/users/3c524d1859304c39ab89a4b0ab86995d` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:27.726130 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c524d1859304c39ab89a4b0ab86995d)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:27.728093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:27.764754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:27.774922 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c524d1859304c39ab89a4b0ab86995d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.781749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c524d1859304c39ab89a4b0ab86995d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.782954 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c524d1859304c39ab89a4b0ab86995d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.783587 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c524d1859304c39ab89a4b0ab86995d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.791054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b26ac8fc-07f8-4db6-8992-327ba0b2984e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c524d1859304c39ab89a4b0ab86995d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:27.807648 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1192/2364] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:56:27 2022] DELETE /identity/v3/users/3c524d1859304c39ab89a4b0ab86995d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:28.081072 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:28.082539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:28.096619 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1c399-ea89-4b03-8f51-88cf39b2eb67 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:28.155057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:28.155715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.155911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.156184 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] PATH_INFO: `/v3/projects/53baf59d6c514425bd1f4ef5470c6172` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.157310 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=53baf59d6c514425bd1f4ef5470c6172)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:28.159184 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:28.204852 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53baf59d6c514425bd1f4ef5470c6172', 'request_id': 'req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:28.210982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53baf59d6c514425bd1f4ef5470c6172', 'request_id': 'req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:28.217701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53baf59d6c514425bd1f4ef5470c6172', 'request_id': 'req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:28.228555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] The token cache is being invalidate because project 53baf59d6c514425bd1f4ef5470c6172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:28.228847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:28.229512 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-928ab8e5-41e9-4b61-ba04-88c8c91fd1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:28.231010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1173/2365] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:28 2022] DELETE /identity/v3/projects/53baf59d6c514425bd1f4ef5470c6172 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:28.235996 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d43ae-1eab-428a-a272-0096a072f5ad None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.236486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d43ae-1eab-428a-a272-0096a072f5ad None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.236593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d43ae-1eab-428a-a272-0096a072f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.256612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-e28d43ae-1eab-428a-a272-0096a072f5ad None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:28.257811 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-e28d43ae-1eab-428a-a272-0096a072f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:28.316238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1193/2366] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:28.323918 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b09438-4a72-4242-bb42-dc3086ba920f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.324261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b09438-4a72-4242-bb42-dc3086ba920f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.324541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b09438-4a72-4242-bb42-dc3086ba920f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.344819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-97b09438-4a72-4242-bb42-dc3086ba920f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:28.346116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-97b09438-4a72-4242-bb42-dc3086ba920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:28.354009 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1174/2367] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:28.358056 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d43ae-1eab-428a-a272-0096a072f5ad None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:28.367879 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d43ae-1eab-428a-a272-0096a072f5ad None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:28.372518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575884c9-e3a6-4ba4-b4fe-13ccdcd6e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:28.373113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575884c9-e3a6-4ba4-b4fe-13ccdcd6e05a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.373625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575884c9-e3a6-4ba4-b4fe-13ccdcd6e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.373908 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575884c9-e3a6-4ba4-b4fe-13ccdcd6e05a admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.374548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575884c9-e3a6-4ba4-b4fe-13ccdcd6e05a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:56:28.374855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575884c9-e3a6-4ba4-b4fe-13ccdcd6e05a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:28.377018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575884c9-e3a6-4ba4-b4fe-13ccdcd6e05a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:28.388939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1194/2368] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:56:28.393278 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b09438-4a72-4242-bb42-dc3086ba920f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:28.402577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b09438-4a72-4242-bb42-dc3086ba920f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:28.407945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8fff3-c24b-4f3d-8b59-3f6f44f3c737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:28.408484 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8fff3-c24b-4f3d-8b59-3f6f44f3c737 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.408771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8fff3-c24b-4f3d-8b59-3f6f44f3c737 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.409045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8fff3-c24b-4f3d-8b59-3f6f44f3c737 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.409667 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8fff3-c24b-4f3d-8b59-3f6f44f3c737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:28.411585 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8fff3-c24b-4f3d-8b59-3f6f44f3c737 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:28.438427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1175/2369] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:56:28 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:28.442486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575884c9-e3a6-4ba4-b4fe-13ccdcd6e05a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:28.452389 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575884c9-e3a6-4ba4-b4fe-13ccdcd6e05a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:28.507919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937263ce-b9a3-4e9d-8ee7-5798d2dd4a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:28.508521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937263ce-b9a3-4e9d-8ee7-5798d2dd4a44 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.508801 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937263ce-b9a3-4e9d-8ee7-5798d2dd4a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.509076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937263ce-b9a3-4e9d-8ee7-5798d2dd4a44 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.509698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937263ce-b9a3-4e9d-8ee7-5798d2dd4a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:28.511659 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937263ce-b9a3-4e9d-8ee7-5798d2dd4a44 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:28.533699 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1195/2370] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:56:28 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:56:28.537824 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8fff3-c24b-4f3d-8b59-3f6f44f3c737 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:28.548655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8fff3-c24b-4f3d-8b59-3f6f44f3c737 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:28.553505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3fe6-3d25-4041-97bb-eb44dc1f8a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:28.554106 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3fe6-3d25-4041-97bb-eb44dc1f8a8b admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.554391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3fe6-3d25-4041-97bb-eb44dc1f8a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.554670 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3fe6-3d25-4041-97bb-eb44dc1f8a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.555339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3fe6-3d25-4041-97bb-eb44dc1f8a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:28.556947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3fe6-3d25-4041-97bb-eb44dc1f8a8b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:28.567674 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1176/2371] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:28.571809 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937263ce-b9a3-4e9d-8ee7-5798d2dd4a44 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:28.582888 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937263ce-b9a3-4e9d-8ee7-5798d2dd4a44 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:28.588002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ba337-e55e-4f93-8e15-37ab2fbcac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:28.588602 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ba337-e55e-4f93-8e15-37ab2fbcac93 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.588885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ba337-e55e-4f93-8e15-37ab2fbcac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.589161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ba337-e55e-4f93-8e15-37ab2fbcac93 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.589798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ba337-e55e-4f93-8e15-37ab2fbcac93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:28.591460 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ba337-e55e-4f93-8e15-37ab2fbcac93 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:28.601947 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1196/2372] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:28.606190 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3fe6-3d25-4041-97bb-eb44dc1f8a8b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:28.617678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3fe6-3d25-4041-97bb-eb44dc1f8a8b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:28.622316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab482f6-a9c2-4350-8f20-06337ca42345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:28.622961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab482f6-a9c2-4350-8f20-06337ca42345 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.623244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab482f6-a9c2-4350-8f20-06337ca42345 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.623553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab482f6-a9c2-4350-8f20-06337ca42345 admin admin] PATH_INFO: `/v3/projects/895a1c0b648f4c8b95de84a5d354d700/users/940312b8a1c5479987b67f60060c49f7/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.638002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab482f6-a9c2-4350-8f20-06337ca42345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895a1c0b648f4c8b95de84a5d354d700, user_id=940312b8a1c5479987b67f60060c49f7, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:28.640675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab482f6-a9c2-4350-8f20-06337ca42345 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:28.650998 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:28.656166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1177/2373] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:28 2022] PUT /identity/v3/projects/895a1c0b648f4c8b95de84a5d354d700/users/940312b8a1c5479987b67f60060c49f7/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:28.668589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4b8e-601a-4491-b2f0-8ea5a8ec29e2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.668818 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4b8e-601a-4491-b2f0-8ea5a8ec29e2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.669114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4b8e-601a-4491-b2f0-8ea5a8ec29e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.696456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-b82a4b8e-601a-4491-b2f0-8ea5a8ec29e2 None None] MFA Rules not processed for user `940312b8a1c5479987b67f60060c49f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:28.697696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-b82a4b8e-601a-4491-b2f0-8ea5a8ec29e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:28.706503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:28.763610 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1197/2374] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:28.768636 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab482f6-a9c2-4350-8f20-06337ca42345 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:28.829830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab482f6-a9c2-4350-8f20-06337ca42345 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:28.834501 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72173-f5b6-4774-8560-2d7e2c5b9601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:28.835095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72173-f5b6-4774-8560-2d7e2c5b9601 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.835410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72173-f5b6-4774-8560-2d7e2c5b9601 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.835685 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72173-f5b6-4774-8560-2d7e2c5b9601 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.836313 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a72173-f5b6-4774-8560-2d7e2c5b9601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:28.838194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a72173-f5b6-4774-8560-2d7e2c5b9601 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:28.863479 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1178/2375] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:56:28 2022] POST /identity/v3/projects => generated 401 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:28.867325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a4b8e-601a-4491-b2f0-8ea5a8ec29e2 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:28.878250 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a4b8e-601a-4491-b2f0-8ea5a8ec29e2 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:28.933928 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f48d02-768d-4e45-99c4-b6c5b2e6c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:28.934462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f48d02-768d-4e45-99c4-b6c5b2e6c622 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.934744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f48d02-768d-4e45-99c4-b6c5b2e6c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.935020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f48d02-768d-4e45-99c4-b6c5b2e6c622 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.935706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f48d02-768d-4e45-99c4-b6c5b2e6c622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:28.937625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f48d02-768d-4e45-99c4-b6c5b2e6c622 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:28.959901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1198/2376] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:56:28 2022] POST /identity/v3/users => generated 307 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:56:28.963962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72173-f5b6-4774-8560-2d7e2c5b9601 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:28.974244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72173-f5b6-4774-8560-2d7e2c5b9601 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:28.978911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa5aa8-6b73-4fd9-ad62-5cef85296a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:28.979542 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa5aa8-6b73-4fd9-ad62-5cef85296a37 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:28.979825 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa5aa8-6b73-4fd9-ad62-5cef85296a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:28.980126 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa5aa8-6b73-4fd9-ad62-5cef85296a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:28.980760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa5aa8-6b73-4fd9-ad62-5cef85296a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:28.982376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa5aa8-6b73-4fd9-ad62-5cef85296a37 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:28.992901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1179/2377] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:28.997056 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f48d02-768d-4e45-99c4-b6c5b2e6c622 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:29.007972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f48d02-768d-4e45-99c4-b6c5b2e6c622 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:29.012650 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e0001-89f1-46b3-8a25-f7471ca12a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:29.013293 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e0001-89f1-46b3-8a25-f7471ca12a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:29.013579 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e0001-89f1-46b3-8a25-f7471ca12a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:29.013859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e0001-89f1-46b3-8a25-f7471ca12a18 admin admin] PATH_INFO: `/v3/projects/8095fca4e3514454ae37bc9606425e68/users/1321b4ab8ffe4458b61fb8f81991646b/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:29.028745 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e0001-89f1-46b3-8a25-f7471ca12a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8095fca4e3514454ae37bc9606425e68, user_id=1321b4ab8ffe4458b61fb8f81991646b, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:29.031504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e0001-89f1-46b3-8a25-f7471ca12a18 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:29.044299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1199/2378] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:28 2022] PUT /identity/v3/projects/8095fca4e3514454ae37bc9606425e68/users/1321b4ab8ffe4458b61fb8f81991646b/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:29.048136 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa5aa8-6b73-4fd9-ad62-5cef85296a37 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:29.058048 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa5aa8-6b73-4fd9-ad62-5cef85296a37 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:29.113823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cfd8c-2397-4690-b95f-28c9d00df9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:29.114437 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cfd8c-2397-4690-b95f-28c9d00df9ff admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:29.114724 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cfd8c-2397-4690-b95f-28c9d00df9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:29.115003 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cfd8c-2397-4690-b95f-28c9d00df9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:29.115677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cfd8c-2397-4690-b95f-28c9d00df9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:29.117261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cfd8c-2397-4690-b95f-28c9d00df9ff admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:29.127599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1180/2379] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:29.131681 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e0001-89f1-46b3-8a25-f7471ca12a18 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:29.142511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e0001-89f1-46b3-8a25-f7471ca12a18 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:29.147115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3140a-cc0a-4a57-a555-53a44cb3b94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:29.147793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3140a-cc0a-4a57-a555-53a44cb3b94f admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:29.148072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3140a-cc0a-4a57-a555-53a44cb3b94f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:29.148346 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3140a-cc0a-4a57-a555-53a44cb3b94f admin admin] PATH_INFO: `/v3/projects/8095fca4e3514454ae37bc9606425e68/users/1321b4ab8ffe4458b61fb8f81991646b/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:29.150302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3140a-cc0a-4a57-a555-53a44cb3b94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8095fca4e3514454ae37bc9606425e68, user_id=1321b4ab8ffe4458b61fb8f81991646b, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:29.152967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3140a-cc0a-4a57-a555-53a44cb3b94f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:29.162985 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1200/2380] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:29 2022] PUT /identity/v3/projects/8095fca4e3514454ae37bc9606425e68/users/1321b4ab8ffe4458b61fb8f81991646b/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:29.173423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328094f-beb2-4144-abb7-2dca742d7464 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:29.173899 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328094f-beb2-4144-abb7-2dca742d7464 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:29.174005 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328094f-beb2-4144-abb7-2dca742d7464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:29.202455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-8328094f-beb2-4144-abb7-2dca742d7464 None None] MFA Rules not processed for user `1321b4ab8ffe4458b61fb8f81991646b`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:29.203782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8328094f-beb2-4144-abb7-2dca742d7464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:29.261876 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:29.272006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1181/2381] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:29 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:29.282751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3140a-cc0a-4a57-a555-53a44cb3b94f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:29.284639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-f2a3140a-cc0a-4a57-a555-53a44cb3b94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:29.342396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3140a-cc0a-4a57-a555-53a44cb3b94f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:29.346033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c5594-6ad2-48ab-845b-9d639427f43b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:29.346660 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5594-6ad2-48ab-845b-9d639427f43b service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:29.346939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5594-6ad2-48ab-845b-9d639427f43b service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:29.347213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5594-6ad2-48ab-845b-9d639427f43b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:29.356061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c5594-6ad2-48ab-845b-9d639427f43b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:29.357474 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c5594-6ad2-48ab-845b-9d639427f43b service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:29.367222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1201/2382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:29 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:29.442809 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328094f-beb2-4144-abb7-2dca742d7464 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:29.452954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328094f-beb2-4144-abb7-2dca742d7464 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:29.456644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25573fa8-e9f9-4287-aaa0-08328b18d9ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:29.457248 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573fa8-e9f9-4287-aaa0-08328b18d9ff service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:29.457533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573fa8-e9f9-4287-aaa0-08328b18d9ff service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:29.457811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573fa8-e9f9-4287-aaa0-08328b18d9ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:29.514065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25573fa8-e9f9-4287-aaa0-08328b18d9ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:29.515577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25573fa8-e9f9-4287-aaa0-08328b18d9ff service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:29.524814 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1182/2383] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:56:33.555696 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c5594-6ad2-48ab-845b-9d639427f43b service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:33.564569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:33.621177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c5594-6ad2-48ab-845b-9d639427f43b service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:33.626131 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:33.626749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:33.627026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:33.627321 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] PATH_INFO: `/v3/users/940312b8a1c5479987b67f60060c49f7` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:33.628418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=940312b8a1c5479987b67f60060c49f7)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:33.630315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:33.675052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940312b8a1c5479987b67f60060c49f7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:33.681738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940312b8a1c5479987b67f60060c49f7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:33.682387 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940312b8a1c5479987b67f60060c49f7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:33.683002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940312b8a1c5479987b67f60060c49f7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:33.689951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940312b8a1c5479987b67f60060c49f7'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:33.707122 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1202/2384] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:56:33 2022] DELETE /identity/v3/users/940312b8a1c5479987b67f60060c49f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:33.711577 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc24f2-67d6-4601-9548-3c02da73e011 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:33.712064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc24f2-67d6-4601-9548-3c02da73e011 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:33.712164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc24f2-67d6-4601-9548-3c02da73e011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:33.730922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-36bc24f2-67d6-4601-9548-3c02da73e011 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:33.732166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-36bc24f2-67d6-4601-9548-3c02da73e011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:33.791401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1183/2385] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:33.801563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:33.802980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:33.859191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dcf3f-c547-4d21-a30a-f4fa0fa2cf19 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:33.863409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff4337-079b-43d0-bf9b-9008629e0a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:33.864015 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff4337-079b-43d0-bf9b-9008629e0a4a service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:33.864296 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff4337-079b-43d0-bf9b-9008629e0a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:33.864570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff4337-079b-43d0-bf9b-9008629e0a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:33.873339 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff4337-079b-43d0-bf9b-9008629e0a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:33.874756 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff4337-079b-43d0-bf9b-9008629e0a4a service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:33.884602 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1203/2386] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:34.146000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc24f2-67d6-4601-9548-3c02da73e011 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:34.147478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-36bc24f2-67d6-4601-9548-3c02da73e011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:34.163296 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc24f2-67d6-4601-9548-3c02da73e011 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:34.169258 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:34.169937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:34.170216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:34.170492 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] PATH_INFO: `/v3/projects/895a1c0b648f4c8b95de84a5d354d700` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:34.171731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=895a1c0b648f4c8b95de84a5d354d700)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:34.173782 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:34.220608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895a1c0b648f4c8b95de84a5d354d700', 'request_id': 'req-a384de87-fe1a-46e0-893e-802823c8b9ec'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.226885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895a1c0b648f4c8b95de84a5d354d700', 'request_id': 'req-a384de87-fe1a-46e0-893e-802823c8b9ec'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.234195 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895a1c0b648f4c8b95de84a5d354d700', 'request_id': 'req-a384de87-fe1a-46e0-893e-802823c8b9ec'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.244493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] The token cache is being invalidate because project 895a1c0b648f4c8b95de84a5d354d700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:34.244779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.245408 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.246909 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1184/2387] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:34 2022] DELETE /identity/v3/projects/895a1c0b648f4c8b95de84a5d354d700 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:34.251429 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff4337-079b-43d0-bf9b-9008629e0a4a service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:34.260881 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff4337-079b-43d0-bf9b-9008629e0a4a service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:34.284399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:34.318319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:34.318971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:34.319253 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:34.319549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] PATH_INFO: `/v3/users/1321b4ab8ffe4458b61fb8f81991646b` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:34.320649 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1321b4ab8ffe4458b61fb8f81991646b)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:34.322556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:34.366695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1321b4ab8ffe4458b61fb8f81991646b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.373382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1321b4ab8ffe4458b61fb8f81991646b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.374031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1321b4ab8ffe4458b61fb8f81991646b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.374634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1321b4ab8ffe4458b61fb8f81991646b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.382478 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-1b1edac6-9ae2-4feb-95d6-c858046e398e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1321b4ab8ffe4458b61fb8f81991646b'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.399828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1204/2388] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:56:34 2022] DELETE /identity/v3/users/1321b4ab8ffe4458b61fb8f81991646b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:34.672403 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:34.674074 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:34.691817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384de87-fe1a-46e0-893e-802823c8b9ec admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:34.706257 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:34.753001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:34.753646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:34.753817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:34.754086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] PATH_INFO: `/v3/projects/8095fca4e3514454ae37bc9606425e68` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:34.755206 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8095fca4e3514454ae37bc9606425e68)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:34.757122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:34.804051 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8095fca4e3514454ae37bc9606425e68', 'request_id': 'req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.810451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8095fca4e3514454ae37bc9606425e68', 'request_id': 'req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.818974 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8095fca4e3514454ae37bc9606425e68', 'request_id': 'req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.830269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] The token cache is being invalidate because project 8095fca4e3514454ae37bc9606425e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:34.830558 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.831207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-72bb9043-52cc-4aa6-a66d-db4c8a1e40e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:34.832959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1185/2389] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:34 2022] DELETE /identity/v3/projects/8095fca4e3514454ae37bc9606425e68 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:34.837593 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5109b06-2dd1-4d8c-94c9-cf78d49a4af4 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:34.838124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5109b06-2dd1-4d8c-94c9-cf78d49a4af4 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:34.838246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5109b06-2dd1-4d8c-94c9-cf78d49a4af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:34.857522 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c5109b06-2dd1-4d8c-94c9-cf78d49a4af4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:34.858720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c5109b06-2dd1-4d8c-94c9-cf78d49a4af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:34.917518 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1205/2390] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:56:34.925451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42aa95-1ca5-42ee-ad32-89282ae8a87a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:34.925737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42aa95-1ca5-42ee-ad32-89282ae8a87a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:34.926053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42aa95-1ca5-42ee-ad32-89282ae8a87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:34.946118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-cc42aa95-1ca5-42ee-ad32-89282ae8a87a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:34.947352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-cc42aa95-1ca5-42ee-ad32-89282ae8a87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:34.955497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1186/2391] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:34.959526 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5109b06-2dd1-4d8c-94c9-cf78d49a4af4 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:34.968951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5109b06-2dd1-4d8c-94c9-cf78d49a4af4 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:34.973971 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637df19-a01f-4679-bf58-237e57cac9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:34.974560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637df19-a01f-4679-bf58-237e57cac9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:34.974839 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637df19-a01f-4679-bf58-237e57cac9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:34.975113 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637df19-a01f-4679-bf58-237e57cac9b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:34.975783 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637df19-a01f-4679-bf58-237e57cac9b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:56:34.976080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637df19-a01f-4679-bf58-237e57cac9b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:34.977661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637df19-a01f-4679-bf58-237e57cac9b5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:34.988896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1206/2392] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:56:34.992908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42aa95-1ca5-42ee-ad32-89282ae8a87a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.002548 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42aa95-1ca5-42ee-ad32-89282ae8a87a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.007557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0086cb-aa1d-4d0f-9065-60e586eba8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.008091 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0086cb-aa1d-4d0f-9065-60e586eba8bd admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.008370 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0086cb-aa1d-4d0f-9065-60e586eba8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.008645 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0086cb-aa1d-4d0f-9065-60e586eba8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.009263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0086cb-aa1d-4d0f-9065-60e586eba8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.011171 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0086cb-aa1d-4d0f-9065-60e586eba8bd admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.037918 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1187/2393] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:56:34 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:35.041930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637df19-a01f-4679-bf58-237e57cac9b5 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.051667 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637df19-a01f-4679-bf58-237e57cac9b5 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.081799 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:35.110555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee27f8-7f7d-4cf0-a536-7fa04e827587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.111242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee27f8-7f7d-4cf0-a536-7fa04e827587 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.111557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee27f8-7f7d-4cf0-a536-7fa04e827587 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.111834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee27f8-7f7d-4cf0-a536-7fa04e827587 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.112483 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee27f8-7f7d-4cf0-a536-7fa04e827587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.114411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee27f8-7f7d-4cf0-a536-7fa04e827587 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.135094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1207/2394] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:56:35 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:35.139326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0086cb-aa1d-4d0f-9065-60e586eba8bd admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.150012 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0086cb-aa1d-4d0f-9065-60e586eba8bd admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.154679 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ed851-0989-41f4-bf93-847d4b95cbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.155332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ed851-0989-41f4-bf93-847d4b95cbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.155621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ed851-0989-41f4-bf93-847d4b95cbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.155901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ed851-0989-41f4-bf93-847d4b95cbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.156539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ed851-0989-41f4-bf93-847d4b95cbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.158135 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ed851-0989-41f4-bf93-847d4b95cbb0 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.168097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1188/2395] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:56:35.171878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee27f8-7f7d-4cf0-a536-7fa04e827587 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.182103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee27f8-7f7d-4cf0-a536-7fa04e827587 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.186717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052ae2d-b96d-4306-a550-99a37c3bc5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.187325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052ae2d-b96d-4306-a550-99a37c3bc5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.187617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052ae2d-b96d-4306-a550-99a37c3bc5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.187893 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052ae2d-b96d-4306-a550-99a37c3bc5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.188575 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052ae2d-b96d-4306-a550-99a37c3bc5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.190174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052ae2d-b96d-4306-a550-99a37c3bc5f5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.199926 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1208/2396] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:35.204388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ed851-0989-41f4-bf93-847d4b95cbb0 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.214193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ed851-0989-41f4-bf93-847d4b95cbb0 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.218889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e941f7-fd4d-4690-9496-f209def2d568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.219618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e941f7-fd4d-4690-9496-f209def2d568 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.219904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e941f7-fd4d-4690-9496-f209def2d568 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.220185 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e941f7-fd4d-4690-9496-f209def2d568 admin admin] PATH_INFO: `/v3/projects/35b6a799405c457093979d1bba0bc7f9/users/f2614ee79cfe4110a75f1f2e5178b34c/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.236110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e941f7-fd4d-4690-9496-f209def2d568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b6a799405c457093979d1bba0bc7f9, user_id=f2614ee79cfe4110a75f1f2e5178b34c, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.238734 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e941f7-fd4d-4690-9496-f209def2d568 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.252702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1189/2397] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:35 2022] PUT /identity/v3/projects/35b6a799405c457093979d1bba0bc7f9/users/f2614ee79cfe4110a75f1f2e5178b34c/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:35.263827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81669d-2802-4039-a5b7-3cb1d71ca796 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.264038 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81669d-2802-4039-a5b7-3cb1d71ca796 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.264325 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81669d-2802-4039-a5b7-3cb1d71ca796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.291272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-5f81669d-2802-4039-a5b7-3cb1d71ca796 None None] MFA Rules not processed for user `f2614ee79cfe4110a75f1f2e5178b34c`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:35.292501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-5f81669d-2802-4039-a5b7-3cb1d71ca796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:35.355305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1209/2398] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:35.359815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e941f7-fd4d-4690-9496-f209def2d568 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.404440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:35.422013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e941f7-fd4d-4690-9496-f209def2d568 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.426651 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de12f-0b02-44a0-8536-951524509e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.427274 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de12f-0b02-44a0-8536-951524509e52 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.427579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de12f-0b02-44a0-8536-951524509e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.427851 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de12f-0b02-44a0-8536-951524509e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.428470 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935de12f-0b02-44a0-8536-951524509e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.430348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935de12f-0b02-44a0-8536-951524509e52 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.456002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1190/2399] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:56:35 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:35.460217 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81669d-2802-4039-a5b7-3cb1d71ca796 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.471170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81669d-2802-4039-a5b7-3cb1d71ca796 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.525547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e256331-0731-4b92-87b9-3ac534cac462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.526078 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e256331-0731-4b92-87b9-3ac534cac462 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.526355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e256331-0731-4b92-87b9-3ac534cac462 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.526625 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e256331-0731-4b92-87b9-3ac534cac462 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.527235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e256331-0731-4b92-87b9-3ac534cac462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.529156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e256331-0731-4b92-87b9-3ac534cac462 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.550026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1210/2400] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:56:35 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:35.554109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de12f-0b02-44a0-8536-951524509e52 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.565174 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de12f-0b02-44a0-8536-951524509e52 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.569737 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff5c86-51e6-489a-beb5-299e659ef207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.570338 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff5c86-51e6-489a-beb5-299e659ef207 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.570618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff5c86-51e6-489a-beb5-299e659ef207 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.570889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff5c86-51e6-489a-beb5-299e659ef207 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.571557 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff5c86-51e6-489a-beb5-299e659ef207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.573146 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff5c86-51e6-489a-beb5-299e659ef207 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.584956 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1191/2401] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:35.589081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e256331-0731-4b92-87b9-3ac534cac462 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.598921 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e256331-0731-4b92-87b9-3ac534cac462 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.603596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cbfd6-b986-4594-8026-c7fa872feac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.604273 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cbfd6-b986-4594-8026-c7fa872feac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.604552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cbfd6-b986-4594-8026-c7fa872feac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.604855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cbfd6-b986-4594-8026-c7fa872feac5 admin admin] PATH_INFO: `/v3/projects/12fd0613c9814fafac1259e16aad5063/users/a363694c3f8a4888b6906337944b8c6f/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.619501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cbfd6-b986-4594-8026-c7fa872feac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fd0613c9814fafac1259e16aad5063, user_id=a363694c3f8a4888b6906337944b8c6f, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.622150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cbfd6-b986-4594-8026-c7fa872feac5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.635963 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1211/2402] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:35 2022] PUT /identity/v3/projects/12fd0613c9814fafac1259e16aad5063/users/a363694c3f8a4888b6906337944b8c6f/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:35.639789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff5c86-51e6-489a-beb5-299e659ef207 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.650296 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff5c86-51e6-489a-beb5-299e659ef207 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.705841 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7a1f8-6e2b-4d3a-9407-30022c91b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.706440 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7a1f8-6e2b-4d3a-9407-30022c91b843 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.706719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7a1f8-6e2b-4d3a-9407-30022c91b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.706989 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7a1f8-6e2b-4d3a-9407-30022c91b843 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.707646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7a1f8-6e2b-4d3a-9407-30022c91b843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.709234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7a1f8-6e2b-4d3a-9407-30022c91b843 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.718895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1192/2403] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:35.723557 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cbfd6-b986-4594-8026-c7fa872feac5 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.733804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cbfd6-b986-4594-8026-c7fa872feac5 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.739053 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47379567-93c8-4dd9-b6c4-5a77e2f85eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.739737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47379567-93c8-4dd9-b6c4-5a77e2f85eae admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.740022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47379567-93c8-4dd9-b6c4-5a77e2f85eae admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.740293 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47379567-93c8-4dd9-b6c4-5a77e2f85eae admin admin] PATH_INFO: `/v3/projects/12fd0613c9814fafac1259e16aad5063/users/a363694c3f8a4888b6906337944b8c6f/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.742193 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47379567-93c8-4dd9-b6c4-5a77e2f85eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fd0613c9814fafac1259e16aad5063, user_id=a363694c3f8a4888b6906337944b8c6f, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.744898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47379567-93c8-4dd9-b6c4-5a77e2f85eae admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.747050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:35.756556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1212/2404] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:35 2022] PUT /identity/v3/projects/12fd0613c9814fafac1259e16aad5063/users/a363694c3f8a4888b6906337944b8c6f/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:56:35.766657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218311-a689-4e28-81f5-f2e567be4c75 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.767142 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218311-a689-4e28-81f5-f2e567be4c75 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.767243 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218311-a689-4e28-81f5-f2e567be4c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.794937 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-89218311-a689-4e28-81f5-f2e567be4c75 None None] MFA Rules not processed for user `a363694c3f8a4888b6906337944b8c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:35.796108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-89218311-a689-4e28-81f5-f2e567be4c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:35.863893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1193/2405] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:35.874386 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47379567-93c8-4dd9-b6c4-5a77e2f85eae admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:35.876258 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-47379567-93c8-4dd9-b6c4-5a77e2f85eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:35.937588 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47379567-93c8-4dd9-b6c4-5a77e2f85eae admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:35.941206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aae17-4c30-4b01-95de-dfb5f9bb60ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:35.941803 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aae17-4c30-4b01-95de-dfb5f9bb60ae service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:35.942086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aae17-4c30-4b01-95de-dfb5f9bb60ae service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:35.942360 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aae17-4c30-4b01-95de-dfb5f9bb60ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:35.957711 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aae17-4c30-4b01-95de-dfb5f9bb60ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:35.959155 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aae17-4c30-4b01-95de-dfb5f9bb60ae service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:35.968659 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1213/2406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:36.080665 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218311-a689-4e28-81f5-f2e567be4c75 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:36.090382 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89218311-a689-4e28-81f5-f2e567be4c75 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:36.093969 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b415c-8b6c-4e15-997f-180073a70a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:36.095118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b415c-8b6c-4e15-997f-180073a70a5d service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:36.095428 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b415c-8b6c-4e15-997f-180073a70a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:36.095705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b415c-8b6c-4e15-997f-180073a70a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:36.133662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:36.152905 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b415c-8b6c-4e15-997f-180073a70a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:36.154346 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b415c-8b6c-4e15-997f-180073a70a5d service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:36.163866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1194/2407] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:38.740729 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aae17-4c30-4b01-95de-dfb5f9bb60ae service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:38.802052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aae17-4c30-4b01-95de-dfb5f9bb60ae service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:38.806618 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:38.807244 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:38.807552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:38.807827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] PATH_INFO: `/v3/users/f2614ee79cfe4110a75f1f2e5178b34c` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:38.808933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2614ee79cfe4110a75f1f2e5178b34c)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:38.810851 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:38.857358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2614ee79cfe4110a75f1f2e5178b34c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:38.864800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2614ee79cfe4110a75f1f2e5178b34c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:38.865456 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2614ee79cfe4110a75f1f2e5178b34c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:38.866050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2614ee79cfe4110a75f1f2e5178b34c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:38.873771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2614ee79cfe4110a75f1f2e5178b34c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:38.898301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1214/2408] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:56:38 2022] DELETE /identity/v3/users/f2614ee79cfe4110a75f1f2e5178b34c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:38.903037 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d198-6458-46f5-b07e-46768a6823e9 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:38.903521 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d198-6458-46f5-b07e-46768a6823e9 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:38.903641 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d198-6458-46f5-b07e-46768a6823e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:38.922732 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-2553d198-6458-46f5-b07e-46768a6823e9 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:38.923952 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2553d198-6458-46f5-b07e-46768a6823e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:38.981726 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1195/2409] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:38.991374 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:38.992788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:39.011032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:39.051884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8daced-71ea-483b-919f-9dbda9c1fbc2 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:39.055537 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79071-7fc2-419b-8082-41b92f5ad693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:39.056144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79071-7fc2-419b-8082-41b92f5ad693 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:39.056423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79071-7fc2-419b-8082-41b92f5ad693 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:39.056697 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79071-7fc2-419b-8082-41b92f5ad693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:39.066095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a79071-7fc2-419b-8082-41b92f5ad693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:39.067535 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a79071-7fc2-419b-8082-41b92f5ad693 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:39.076966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1215/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:39.336284 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d198-6458-46f5-b07e-46768a6823e9 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:39.338848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-2553d198-6458-46f5-b07e-46768a6823e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:39.351836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d198-6458-46f5-b07e-46768a6823e9 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:39.356764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:39.357399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:39.357676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:39.357945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] PATH_INFO: `/v3/projects/35b6a799405c457093979d1bba0bc7f9` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:39.359053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b6a799405c457093979d1bba0bc7f9)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:39.362443 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:39.408852 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b6a799405c457093979d1bba0bc7f9', 'request_id': 'req-33352998-5b2f-44a3-8c27-0b88246c3291'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.414924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b6a799405c457093979d1bba0bc7f9', 'request_id': 'req-33352998-5b2f-44a3-8c27-0b88246c3291'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.424125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b6a799405c457093979d1bba0bc7f9', 'request_id': 'req-33352998-5b2f-44a3-8c27-0b88246c3291'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.434655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] The token cache is being invalidate because project 35b6a799405c457093979d1bba0bc7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:39.434971 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.435662 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.437209 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1196/2411] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:39 2022] DELETE /identity/v3/projects/35b6a799405c457093979d1bba0bc7f9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:39.441867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79071-7fc2-419b-8082-41b92f5ad693 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:39.451853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79071-7fc2-419b-8082-41b92f5ad693 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:39.507787 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:39.508425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:39.508706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:39.508984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] PATH_INFO: `/v3/users/a363694c3f8a4888b6906337944b8c6f` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:39.510099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a363694c3f8a4888b6906337944b8c6f)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:39.512062 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:39.558362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a363694c3f8a4888b6906337944b8c6f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.565824 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a363694c3f8a4888b6906337944b8c6f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.566484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a363694c3f8a4888b6906337944b8c6f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.567083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a363694c3f8a4888b6906337944b8c6f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.574929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3e8b6693-ae9e-4337-9fae-e143eac17990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a363694c3f8a4888b6906337944b8c6f'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.592488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1216/2412] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:56:39 2022] DELETE /identity/v3/users/a363694c3f8a4888b6906337944b8c6f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:39.860545 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:39.862184 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:39.877973 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33352998-5b2f-44a3-8c27-0b88246c3291 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:39.934324 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:39.934926 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:39.935147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:39.935456 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] PATH_INFO: `/v3/projects/12fd0613c9814fafac1259e16aad5063` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:39.936579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fd0613c9814fafac1259e16aad5063)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:39.938463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:39.940653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:39.986569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fd0613c9814fafac1259e16aad5063', 'request_id': 'req-3eaea39c-86d6-49d9-8256-d75cf55804c8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:39.992912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fd0613c9814fafac1259e16aad5063', 'request_id': 'req-3eaea39c-86d6-49d9-8256-d75cf55804c8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:40.000818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fd0613c9814fafac1259e16aad5063', 'request_id': 'req-3eaea39c-86d6-49d9-8256-d75cf55804c8'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:40.011991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] The token cache is being invalidate because project 12fd0613c9814fafac1259e16aad5063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:40.012283 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:40.012915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-3eaea39c-86d6-49d9-8256-d75cf55804c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:40.014399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1197/2413] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:39 2022] DELETE /identity/v3/projects/12fd0613c9814fafac1259e16aad5063 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:40.019852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446884cf-5dd1-491d-82cd-05a695e9d557 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.020349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446884cf-5dd1-491d-82cd-05a695e9d557 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.020447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446884cf-5dd1-491d-82cd-05a695e9d557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.041395 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-446884cf-5dd1-491d-82cd-05a695e9d557 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:40.042597 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-446884cf-5dd1-491d-82cd-05a695e9d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:40.074034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:40.102727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1217/2414] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:40.110492 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9ecb-d9fb-470d-997b-098500498a5e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.110764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9ecb-d9fb-470d-997b-098500498a5e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.111045 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9ecb-d9fb-470d-997b-098500498a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.130861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-d48c9ecb-d9fb-470d-997b-098500498a5e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:40.132100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d48c9ecb-d9fb-470d-997b-098500498a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:40.139947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1198/2415] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:40.144617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446884cf-5dd1-491d-82cd-05a695e9d557 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:40.154185 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446884cf-5dd1-491d-82cd-05a695e9d557 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:40.158764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10401a3-60af-42dd-96f4-0567e23b0db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:40.159392 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10401a3-60af-42dd-96f4-0567e23b0db1 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.159679 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10401a3-60af-42dd-96f4-0567e23b0db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.159953 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10401a3-60af-42dd-96f4-0567e23b0db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.160595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10401a3-60af-42dd-96f4-0567e23b0db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:56:40.161016 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10401a3-60af-42dd-96f4-0567e23b0db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:40.162626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10401a3-60af-42dd-96f4-0567e23b0db1 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:40.174040 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1218/2416] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:56:40.178241 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c9ecb-d9fb-470d-997b-098500498a5e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:40.187357 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c9ecb-d9fb-470d-997b-098500498a5e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:40.192497 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60845ecf-57b0-4def-811a-839968dc1bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:40.193088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845ecf-57b0-4def-811a-839968dc1bfb admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.193372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845ecf-57b0-4def-811a-839968dc1bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.193650 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845ecf-57b0-4def-811a-839968dc1bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.194269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60845ecf-57b0-4def-811a-839968dc1bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:40.196196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60845ecf-57b0-4def-811a-839968dc1bfb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:40.230722 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1199/2417] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:56:40 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:40.234682 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10401a3-60af-42dd-96f4-0567e23b0db1 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:40.244875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10401a3-60af-42dd-96f4-0567e23b0db1 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:40.303242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45313331-251d-49d8-a46e-88a15fde85ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:40.303884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45313331-251d-49d8-a46e-88a15fde85ca admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.304168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45313331-251d-49d8-a46e-88a15fde85ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.304441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45313331-251d-49d8-a46e-88a15fde85ca admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.305061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45313331-251d-49d8-a46e-88a15fde85ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:40.306968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45313331-251d-49d8-a46e-88a15fde85ca admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:40.329721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1219/2418] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:56:40 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:40.333836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60845ecf-57b0-4def-811a-839968dc1bfb admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:40.344002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60845ecf-57b0-4def-811a-839968dc1bfb admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:40.348590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c0a13-8013-4cff-a638-288739869a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:40.349181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c0a13-8013-4cff-a638-288739869a3a admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.349464 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c0a13-8013-4cff-a638-288739869a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.349740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c0a13-8013-4cff-a638-288739869a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.350374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c0a13-8013-4cff-a638-288739869a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:40.352055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c0a13-8013-4cff-a638-288739869a3a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:40.361701 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1200/2419] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:40.365308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45313331-251d-49d8-a46e-88a15fde85ca admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:40.376037 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45313331-251d-49d8-a46e-88a15fde85ca admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:40.381418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850bd3a-2ce7-4cda-a56f-0139dac7d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:40.382037 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850bd3a-2ce7-4cda-a56f-0139dac7d32b admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.382320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850bd3a-2ce7-4cda-a56f-0139dac7d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.382589 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850bd3a-2ce7-4cda-a56f-0139dac7d32b admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.383242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850bd3a-2ce7-4cda-a56f-0139dac7d32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:40.384947 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850bd3a-2ce7-4cda-a56f-0139dac7d32b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:40.396044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1220/2420] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:40.400102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c0a13-8013-4cff-a638-288739869a3a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:40.409942 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c0a13-8013-4cff-a638-288739869a3a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:40.414505 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851b3fb-fcf2-4f80-926f-d61a0a4d65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:40.415173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851b3fb-fcf2-4f80-926f-d61a0a4d65bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.415485 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851b3fb-fcf2-4f80-926f-d61a0a4d65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.415764 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851b3fb-fcf2-4f80-926f-d61a0a4d65bb admin admin] PATH_INFO: `/v3/projects/358c66ea02154932827a3e98100fd035/users/c300f6d5ed3a4c2b9223b06f5001bc4d/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.430610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851b3fb-fcf2-4f80-926f-d61a0a4d65bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=358c66ea02154932827a3e98100fd035, user_id=c300f6d5ed3a4c2b9223b06f5001bc4d, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:40.433373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851b3fb-fcf2-4f80-926f-d61a0a4d65bb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:40.446676 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1201/2421] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:40 2022] PUT /identity/v3/projects/358c66ea02154932827a3e98100fd035/users/c300f6d5ed3a4c2b9223b06f5001bc4d/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:40.457930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e293df-0f22-40e8-968e-31441c092416 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.458213 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e293df-0f22-40e8-968e-31441c092416 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.458487 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e293df-0f22-40e8-968e-31441c092416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.486571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-07e293df-0f22-40e8-968e-31441c092416 None None] MFA Rules not processed for user `c300f6d5ed3a4c2b9223b06f5001bc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:40.487802 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-07e293df-0f22-40e8-968e-31441c092416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:40.548882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1221/2422] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:40.560227 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851b3fb-fcf2-4f80-926f-d61a0a4d65bb admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:40.561901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-a851b3fb-fcf2-4f80-926f-d61a0a4d65bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:40.618680 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851b3fb-fcf2-4f80-926f-d61a0a4d65bb admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:40.622351 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c532684-472c-4fe4-9b15-2781a6098aed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:40.622961 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532684-472c-4fe4-9b15-2781a6098aed service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.623246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532684-472c-4fe4-9b15-2781a6098aed service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.623555 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532684-472c-4fe4-9b15-2781a6098aed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.632706 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c532684-472c-4fe4-9b15-2781a6098aed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:40.634129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c532684-472c-4fe4-9b15-2781a6098aed service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:40.642908 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1202/2423] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:40.661626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e293df-0f22-40e8-968e-31441c092416 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:40.695306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:40.727132 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e293df-0f22-40e8-968e-31441c092416 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:40.731654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:40.732280 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.732559 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.732830 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] PATH_INFO: `/v3/users/c300f6d5ed3a4c2b9223b06f5001bc4d` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.733941 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c300f6d5ed3a4c2b9223b06f5001bc4d)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:40.736410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:40.782301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c300f6d5ed3a4c2b9223b06f5001bc4d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:40.789278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c300f6d5ed3a4c2b9223b06f5001bc4d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:40.789950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c300f6d5ed3a4c2b9223b06f5001bc4d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:40.790595 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c300f6d5ed3a4c2b9223b06f5001bc4d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:40.798271 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c300f6d5ed3a4c2b9223b06f5001bc4d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:40.817111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1222/2424] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:56:40 2022] DELETE /identity/v3/users/c300f6d5ed3a4c2b9223b06f5001bc4d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:40.821684 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ccd7-4938-48b0-8107-49ebd93e147c None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.821983 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ccd7-4938-48b0-8107-49ebd93e147c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.822263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ccd7-4938-48b0-8107-49ebd93e147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:40.844064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-47b2ccd7-4938-48b0-8107-49ebd93e147c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:40.845267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-47b2ccd7-4938-48b0-8107-49ebd93e147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:40.881239 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:40.918775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1203/2425] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:40.928616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:40.930025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:40.991000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cd377-2340-40c4-b81f-8721870ae559 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:40.994788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36afcb-2a81-4443-89e8-71a4a5f23f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:40.995494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36afcb-2a81-4443-89e8-71a4a5f23f94 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:40.995854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36afcb-2a81-4443-89e8-71a4a5f23f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:40.996336 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36afcb-2a81-4443-89e8-71a4a5f23f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.006644 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36afcb-2a81-4443-89e8-71a4a5f23f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:41.008116 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36afcb-2a81-4443-89e8-71a4a5f23f94 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:41.017724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1223/2426] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:41.314469 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2ccd7-4938-48b0-8107-49ebd93e147c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:41.315957 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-47b2ccd7-4938-48b0-8107-49ebd93e147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:41.328344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2ccd7-4938-48b0-8107-49ebd93e147c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:41.333015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:41.333649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:41.333932 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:41.334216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] PATH_INFO: `/v3/projects/358c66ea02154932827a3e98100fd035` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.335359 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=358c66ea02154932827a3e98100fd035)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:41.337273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:41.399182 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358c66ea02154932827a3e98100fd035', 'request_id': 'req-873ea569-30d0-43a4-b629-02864277e5ac'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:41.405395 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358c66ea02154932827a3e98100fd035', 'request_id': 'req-873ea569-30d0-43a4-b629-02864277e5ac'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:41.412910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358c66ea02154932827a3e98100fd035', 'request_id': 'req-873ea569-30d0-43a4-b629-02864277e5ac'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:41.423877 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] The token cache is being invalidate because project 358c66ea02154932827a3e98100fd035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:41.424173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:41.424796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-873ea569-30d0-43a4-b629-02864277e5ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:41.426287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1204/2427] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:41 2022] DELETE /identity/v3/projects/358c66ea02154932827a3e98100fd035 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:41.431155 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926f13-95b1-4edb-b3c3-5bd9db53be69 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:41.431654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926f13-95b1-4edb-b3c3-5bd9db53be69 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:41.431768 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926f13-95b1-4edb-b3c3-5bd9db53be69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.451462 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bf926f13-95b1-4edb-b3c3-5bd9db53be69 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:41.452641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bf926f13-95b1-4edb-b3c3-5bd9db53be69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:41.499815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:41.514623 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1224/2428] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:41.522264 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1248883-649c-444c-adb5-9720853ce5b4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:41.522552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1248883-649c-444c-adb5-9720853ce5b4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:41.522829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1248883-649c-444c-adb5-9720853ce5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.542642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-e1248883-649c-444c-adb5-9720853ce5b4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:41.543884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e1248883-649c-444c-adb5-9720853ce5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:41.552949 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1205/2429] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:41.557136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf926f13-95b1-4edb-b3c3-5bd9db53be69 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:41.567063 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf926f13-95b1-4edb-b3c3-5bd9db53be69 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:41.572227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51b8ea-f201-4ed4-8686-8b71aeb91e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:41.572871 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51b8ea-f201-4ed4-8686-8b71aeb91e1d admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:41.573158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51b8ea-f201-4ed4-8686-8b71aeb91e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:41.573437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51b8ea-f201-4ed4-8686-8b71aeb91e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.574086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51b8ea-f201-4ed4-8686-8b71aeb91e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:56:41.574393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51b8ea-f201-4ed4-8686-8b71aeb91e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:41.576311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51b8ea-f201-4ed4-8686-8b71aeb91e1d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:41.588022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1225/2430] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:56:41.592336 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1248883-649c-444c-adb5-9720853ce5b4 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:41.601931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1248883-649c-444c-adb5-9720853ce5b4 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:41.606624 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7c1d2-8e86-4444-92bc-41e73763a8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:41.607213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7c1d2-8e86-4444-92bc-41e73763a8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:41.607528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7c1d2-8e86-4444-92bc-41e73763a8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:41.607801 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7c1d2-8e86-4444-92bc-41e73763a8c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.608450 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7c1d2-8e86-4444-92bc-41e73763a8c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:41.610873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7c1d2-8e86-4444-92bc-41e73763a8c0 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:41.637402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1206/2431] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:56:41 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:56:41.641703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51b8ea-f201-4ed4-8686-8b71aeb91e1d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:41.651599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51b8ea-f201-4ed4-8686-8b71aeb91e1d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:41.709603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714de86-be45-409e-a73d-1b0983c76fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:41.710209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714de86-be45-409e-a73d-1b0983c76fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:41.710493 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714de86-be45-409e-a73d-1b0983c76fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:41.710771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714de86-be45-409e-a73d-1b0983c76fe0 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.711441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714de86-be45-409e-a73d-1b0983c76fe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:41.713354 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714de86-be45-409e-a73d-1b0983c76fe0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:41.734501 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1226/2432] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:56:41 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:41.739057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7c1d2-8e86-4444-92bc-41e73763a8c0 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:41.749013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7c1d2-8e86-4444-92bc-41e73763a8c0 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:41.753580 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bac1c-65f4-427b-8a3a-574c905feafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:41.754273 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bac1c-65f4-427b-8a3a-574c905feafe admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:41.754552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bac1c-65f4-427b-8a3a-574c905feafe admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:41.754845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bac1c-65f4-427b-8a3a-574c905feafe admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.755509 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bac1c-65f4-427b-8a3a-574c905feafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:41.757234 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bac1c-65f4-427b-8a3a-574c905feafe admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:41.770918 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1207/2433] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:41.775411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714de86-be45-409e-a73d-1b0983c76fe0 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:41.785789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714de86-be45-409e-a73d-1b0983c76fe0 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:41.790417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811798e-ffa7-4ace-9aed-7c2607b330b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:41.791010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811798e-ffa7-4ace-9aed-7c2607b330b1 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:41.791304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811798e-ffa7-4ace-9aed-7c2607b330b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:41.791602 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811798e-ffa7-4ace-9aed-7c2607b330b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.792235 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811798e-ffa7-4ace-9aed-7c2607b330b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:41.793834 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811798e-ffa7-4ace-9aed-7c2607b330b1 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:41.804035 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1227/2434] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:56:41.807991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bac1c-65f4-427b-8a3a-574c905feafe admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:41.817903 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bac1c-65f4-427b-8a3a-574c905feafe admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:41.822618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9b81d-6ea4-46c5-b211-e91d16895a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:41.823265 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9b81d-6ea4-46c5-b211-e91d16895a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:41.823573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9b81d-6ea4-46c5-b211-e91d16895a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:41.823880 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9b81d-6ea4-46c5-b211-e91d16895a6a admin admin] PATH_INFO: `/v3/projects/6363f219150f402bbd63688d67f8814e/users/4bb49a3b1a3941d095ced92f19d504ce/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.838612 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9b81d-6ea4-46c5-b211-e91d16895a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6363f219150f402bbd63688d67f8814e, user_id=4bb49a3b1a3941d095ced92f19d504ce, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:41.841318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9b81d-6ea4-46c5-b211-e91d16895a6a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:41.854372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1208/2435] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:41 2022] PUT /identity/v3/projects/6363f219150f402bbd63688d67f8814e/users/4bb49a3b1a3941d095ced92f19d504ce/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:41.865292 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670725f4-2fb2-44c7-8aa8-040525371338 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:41.865578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670725f4-2fb2-44c7-8aa8-040525371338 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:41.865854 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670725f4-2fb2-44c7-8aa8-040525371338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:41.892815 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-670725f4-2fb2-44c7-8aa8-040525371338 None None] MFA Rules not processed for user `4bb49a3b1a3941d095ced92f19d504ce`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:41.894034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-670725f4-2fb2-44c7-8aa8-040525371338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:41.958950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1228/2436] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:41.970649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9b81d-6ea4-46c5-b211-e91d16895a6a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:41.972550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-aac9b81d-6ea4-46c5-b211-e91d16895a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:42.029263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9b81d-6ea4-46c5-b211-e91d16895a6a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:42.033432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df0d8-5585-4419-9e09-843a980eba21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:42.034041 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df0d8-5585-4419-9e09-843a980eba21 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:42.034326 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df0d8-5585-4419-9e09-843a980eba21 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:42.034603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df0d8-5585-4419-9e09-843a980eba21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:42.039753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:42.044455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df0d8-5585-4419-9e09-843a980eba21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:42.046702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df0d8-5585-4419-9e09-843a980eba21 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:42.055856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1209/2437] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:46.013359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0201b-46cc-4334-91d3-2e2988469f8c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:46.013896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0201b-46cc-4334-91d3-2e2988469f8c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:46.013896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0201b-46cc-4334-91d3-2e2988469f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:46.033527 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-fea0201b-46cc-4334-91d3-2e2988469f8c None None] MFA Rules not processed for user `1d278036e95542b38a80150c6fce26a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:46.034714 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fea0201b-46cc-4334-91d3-2e2988469f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:46.077827 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:46.089082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1229/2438] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:47.407896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df0d8-5585-4419-9e09-843a980eba21 service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:47.471559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df0d8-5585-4419-9e09-843a980eba21 service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:47.476127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:47.476754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:47.477033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:47.477304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] PATH_INFO: `/v3/users/4bb49a3b1a3941d095ced92f19d504ce` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:47.478409 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb49a3b1a3941d095ced92f19d504ce)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:47.480352 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:47.526025 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb49a3b1a3941d095ced92f19d504ce'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:47.533481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb49a3b1a3941d095ced92f19d504ce'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:47.534141 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb49a3b1a3941d095ced92f19d504ce'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:47.534754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb49a3b1a3941d095ced92f19d504ce'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:47.541859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb49a3b1a3941d095ced92f19d504ce'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:47.558750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1210/2439] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:56:47 2022] DELETE /identity/v3/users/4bb49a3b1a3941d095ced92f19d504ce => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:47.563898 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd89c6-ad31-47d7-8b1e-18dcad833a30 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:47.564351 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd89c6-ad31-47d7-8b1e-18dcad833a30 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:47.564448 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd89c6-ad31-47d7-8b1e-18dcad833a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:47.584059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bbcd89c6-ad31-47d7-8b1e-18dcad833a30 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:47.585302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bbcd89c6-ad31-47d7-8b1e-18dcad833a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:47.642550 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1230/2440] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:47.652220 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:47.653605 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:47.709142 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ab58e-ae95-4313-89b5-a8099b999db5 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:47.712774 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca855d1b-6b56-432b-9de5-4cb846ee7dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:47.713380 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca855d1b-6b56-432b-9de5-4cb846ee7dda service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:47.713740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca855d1b-6b56-432b-9de5-4cb846ee7dda service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:47.714010 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca855d1b-6b56-432b-9de5-4cb846ee7dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:47.723570 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca855d1b-6b56-432b-9de5-4cb846ee7dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:47.724987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca855d1b-6b56-432b-9de5-4cb846ee7dda service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:47.734220 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1211/2441] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:56:48.026738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd89c6-ad31-47d7-8b1e-18dcad833a30 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:48.028505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bbcd89c6-ad31-47d7-8b1e-18dcad833a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:48.042417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd89c6-ad31-47d7-8b1e-18dcad833a30 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:48.048585 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:48.049344 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.050463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.050463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] PATH_INFO: `/v3/projects/6363f219150f402bbd63688d67f8814e` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.051430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6363f219150f402bbd63688d67f8814e)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:48.053532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:48.103195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6363f219150f402bbd63688d67f8814e', 'request_id': 'req-b62e43be-6f3a-4136-ae1a-5f0c999e7711'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:48.111432 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6363f219150f402bbd63688d67f8814e', 'request_id': 'req-b62e43be-6f3a-4136-ae1a-5f0c999e7711'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:48.118054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6363f219150f402bbd63688d67f8814e', 'request_id': 'req-b62e43be-6f3a-4136-ae1a-5f0c999e7711'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:48.129018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] The token cache is being invalidate because project 6363f219150f402bbd63688d67f8814e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:48.129310 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:48.129944 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-b62e43be-6f3a-4136-ae1a-5f0c999e7711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:48.131466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1231/2442] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:48 2022] DELETE /identity/v3/projects/6363f219150f402bbd63688d67f8814e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:56:48.136285 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21c35b-3137-4d83-9ba3-8e4d79a15a97 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.136573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21c35b-3137-4d83-9ba3-8e4d79a15a97 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.136848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21c35b-3137-4d83-9ba3-8e4d79a15a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.155939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-8e21c35b-3137-4d83-9ba3-8e4d79a15a97 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:48.157148 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-8e21c35b-3137-4d83-9ba3-8e4d79a15a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:48.166563 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:48.225133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1212/2443] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:48.233884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f284821-152e-46e6-a395-43f4f163d910 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.234716 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f284821-152e-46e6-a395-43f4f163d910 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.234994 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f284821-152e-46e6-a395-43f4f163d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.256280 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-9f284821-152e-46e6-a395-43f4f163d910 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:48.257481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9f284821-152e-46e6-a395-43f4f163d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:48.265355 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1232/2444] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:48.269921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21c35b-3137-4d83-9ba3-8e4d79a15a97 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:48.279834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21c35b-3137-4d83-9ba3-8e4d79a15a97 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:48.284911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3e14-7afb-4eb8-a752-f7a491c49d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:48.285511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3e14-7afb-4eb8-a752-f7a491c49d60 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.285791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3e14-7afb-4eb8-a752-f7a491c49d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.286064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3e14-7afb-4eb8-a752-f7a491c49d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.286699 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd3e14-7afb-4eb8-a752-f7a491c49d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:56:48.286999 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd3e14-7afb-4eb8-a752-f7a491c49d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:48.288613 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd3e14-7afb-4eb8-a752-f7a491c49d60 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:48.300356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1213/2445] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:56:48.304521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f284821-152e-46e6-a395-43f4f163d910 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:48.314480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f284821-152e-46e6-a395-43f4f163d910 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:48.319151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f5be-813c-46b1-9042-1daa6d4a5e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:48.319828 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f5be-813c-46b1-9042-1daa6d4a5e3f admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.320111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f5be-813c-46b1-9042-1daa6d4a5e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.321088 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f5be-813c-46b1-9042-1daa6d4a5e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.321726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7f5be-813c-46b1-9042-1daa6d4a5e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:48.323657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7f5be-813c-46b1-9042-1daa6d4a5e3f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:48.354863 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1233/2446] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:56:48 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:48.356157 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3e14-7afb-4eb8-a752-f7a491c49d60 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:48.366436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3e14-7afb-4eb8-a752-f7a491c49d60 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:48.424040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e6ce6-3c81-434a-8029-fe01cf63ce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:48.424710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e6ce6-3c81-434a-8029-fe01cf63ce55 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.424840 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e6ce6-3c81-434a-8029-fe01cf63ce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.425116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e6ce6-3c81-434a-8029-fe01cf63ce55 admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.425747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e6ce6-3c81-434a-8029-fe01cf63ce55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:48.427691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e6ce6-3c81-434a-8029-fe01cf63ce55 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:48.451328 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1214/2447] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:56:48 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:56:48.454049 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f5be-813c-46b1-9042-1daa6d4a5e3f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:48.464476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f5be-813c-46b1-9042-1daa6d4a5e3f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:48.469128 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a99b54-3f31-4e74-8aba-499fd70d4cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:48.469724 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99b54-3f31-4e74-8aba-499fd70d4cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.470000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99b54-3f31-4e74-8aba-499fd70d4cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.470276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99b54-3f31-4e74-8aba-499fd70d4cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.470984 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a99b54-3f31-4e74-8aba-499fd70d4cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:48.472669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a99b54-3f31-4e74-8aba-499fd70d4cb7 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:48.485885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1234/2448] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:48.487125 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e6ce6-3c81-434a-8029-fe01cf63ce55 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:48.497228 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e6ce6-3c81-434a-8029-fe01cf63ce55 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:48.502918 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c07003-032c-4b9c-ada8-a4bd9f107543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:48.503549 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07003-032c-4b9c-ada8-a4bd9f107543 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.503834 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07003-032c-4b9c-ada8-a4bd9f107543 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.504109 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07003-032c-4b9c-ada8-a4bd9f107543 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.504753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c07003-032c-4b9c-ada8-a4bd9f107543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:48.506398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c07003-032c-4b9c-ada8-a4bd9f107543 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:48.518145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1215/2449] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:56:48.522376 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a99b54-3f31-4e74-8aba-499fd70d4cb7 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:48.532441 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a99b54-3f31-4e74-8aba-499fd70d4cb7 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:48.537013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02c1ad-a42a-412c-94ae-06868389e404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:48.537661 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02c1ad-a42a-412c-94ae-06868389e404 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.537943 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02c1ad-a42a-412c-94ae-06868389e404 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.538216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02c1ad-a42a-412c-94ae-06868389e404 admin admin] PATH_INFO: `/v3/projects/260ad259ae85406f8aaaf739f3686100/users/138c8825a2c24a36b4e3393e0ce1a0b3/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.553425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02c1ad-a42a-412c-94ae-06868389e404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260ad259ae85406f8aaaf739f3686100, user_id=138c8825a2c24a36b4e3393e0ce1a0b3, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:48.558784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02c1ad-a42a-412c-94ae-06868389e404 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:48.570743 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1235/2450] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:56:48 2022] PUT /identity/v3/projects/260ad259ae85406f8aaaf739f3686100/users/138c8825a2c24a36b4e3393e0ce1a0b3/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:48.582365 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d525f-f5ab-4eb2-b6db-27a20f5f45cd None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.582652 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d525f-f5ab-4eb2-b6db-27a20f5f45cd None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.582924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d525f-f5ab-4eb2-b6db-27a20f5f45cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.614771 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b46d525f-f5ab-4eb2-b6db-27a20f5f45cd None None] MFA Rules not processed for user `138c8825a2c24a36b4e3393e0ce1a0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:48.616330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b46d525f-f5ab-4eb2-b6db-27a20f5f45cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:48.698414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1216/2451] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:48.706529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02c1ad-a42a-412c-94ae-06868389e404 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:48.709410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3e02c1ad-a42a-412c-94ae-06868389e404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:48.728006 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:48.774812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02c1ad-a42a-412c-94ae-06868389e404 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:48.780002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60e425-f186-49a4-89cc-360ab24fadf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:48.780652 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e425-f186-49a4-89cc-360ab24fadf4 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:48.780930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e425-f186-49a4-89cc-360ab24fadf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:48.781398 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e425-f186-49a4-89cc-360ab24fadf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:48.790707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60e425-f186-49a4-89cc-360ab24fadf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:48.792246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60e425-f186-49a4-89cc-360ab24fadf4 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:48.802311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1236/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:56:58.691553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:58.798335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=19 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:58.880399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d525f-f5ab-4eb2-b6db-27a20f5f45cd None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:58.949253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d525f-f5ab-4eb2-b6db-27a20f5f45cd None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:58.954110 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:58.954750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:58.955033 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:58.955482 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] PATH_INFO: `/v3/users/138c8825a2c24a36b4e3393e0ce1a0b3` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:58.956642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=138c8825a2c24a36b4e3393e0ce1a0b3)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:58.958556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:59.013410 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '138c8825a2c24a36b4e3393e0ce1a0b3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:59.020766 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '138c8825a2c24a36b4e3393e0ce1a0b3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:59.021528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '138c8825a2c24a36b4e3393e0ce1a0b3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:59.022305 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '138c8825a2c24a36b4e3393e0ce1a0b3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:59.030599 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '138c8825a2c24a36b4e3393e0ce1a0b3'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:59.051419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1217/2453] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:56:58 2022] DELETE /identity/v3/users/138c8825a2c24a36b4e3393e0ce1a0b3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:59.056149 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175d23-9e66-4525-a2ed-05f9d656c2db None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:59.056435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175d23-9e66-4525-a2ed-05f9d656c2db None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:59.057291 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175d23-9e66-4525-a2ed-05f9d656c2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:59.077313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-cd175d23-9e66-4525-a2ed-05f9d656c2db None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:59.078872 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cd175d23-9e66-4525-a2ed-05f9d656c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:59.142114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1237/2454] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:59.151769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:59.153427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:59.214055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ef00f-6c57-4270-9e05-62c09f69c8fc admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:59.217811 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d8b1-14f1-4a34-8ca3-3785c71b8aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:59.218427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d8b1-14f1-4a34-8ca3-3785c71b8aab service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:59.218705 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d8b1-14f1-4a34-8ca3-3785c71b8aab service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:59.218977 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d8b1-14f1-4a34-8ca3-3785c71b8aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:59.230291 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8d8b1-14f1-4a34-8ca3-3785c71b8aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:59.231791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8d8b1-14f1-4a34-8ca3-3785c71b8aab service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:59.241803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1218/2455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 04:56:59.533169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175d23-9e66-4525-a2ed-05f9d656c2db None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:59.534849 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cd175d23-9e66-4525-a2ed-05f9d656c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:59.549874 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175d23-9e66-4525-a2ed-05f9d656c2db None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:59.555120 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:59.559322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:59.559655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:59.559936 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] PATH_INFO: `/v3/projects/260ad259ae85406f8aaaf739f3686100` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:59.561435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=260ad259ae85406f8aaaf739f3686100)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:59.563491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:59.613099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260ad259ae85406f8aaaf739f3686100', 'request_id': 'req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:59.620866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260ad259ae85406f8aaaf739f3686100', 'request_id': 'req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:59.627727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260ad259ae85406f8aaaf739f3686100', 'request_id': 'req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:59.638755 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] The token cache is being invalidate because project 260ad259ae85406f8aaaf739f3686100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:56:59.638965 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:59.639695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-9ba0ae40-df5d-4807-bfaa-0fed9d2b6ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:56:59.641484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1238/2456] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:56:59 2022] DELETE /identity/v3/projects/260ad259ae85406f8aaaf739f3686100 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:56:59.646170 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f36e1-218e-458b-af1d-b2cd5a555bed None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:59.646463 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f36e1-218e-458b-af1d-b2cd5a555bed None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:59.646742 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f36e1-218e-458b-af1d-b2cd5a555bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:59.667338 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-ec8f36e1-218e-458b-af1d-b2cd5a555bed None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:59.668559 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-ec8f36e1-218e-458b-af1d-b2cd5a555bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:59.687384 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:56:59.733451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1219/2457] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:59.798424 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613fc20-a537-4ea6-a6fd-0134a441c95c None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:59.799020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613fc20-a537-4ea6-a6fd-0134a441c95c None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:59.799020 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613fc20-a537-4ea6-a6fd-0134a441c95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:59.819018 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-1613fc20-a537-4ea6-a6fd-0134a441c95c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:56:59.820311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-1613fc20-a537-4ea6-a6fd-0134a441c95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:56:59.828789 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1239/2458] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:56:59.833129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f36e1-218e-458b-af1d-b2cd5a555bed None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:59.843144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f36e1-218e-458b-af1d-b2cd5a555bed None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:59.849182 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd988cb-a06c-4972-8f70-951b0dc832f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:59.849843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd988cb-a06c-4972-8f70-951b0dc832f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:59.850130 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd988cb-a06c-4972-8f70-951b0dc832f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:59.850413 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd988cb-a06c-4972-8f70-951b0dc832f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:59.851069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd988cb-a06c-4972-8f70-951b0dc832f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:56:59.851417 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd988cb-a06c-4972-8f70-951b0dc832f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:59.853016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd988cb-a06c-4972-8f70-951b0dc832f8 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:59.866188 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1220/2459] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:56:59.870700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613fc20-a537-4ea6-a6fd-0134a441c95c None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:59.880188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613fc20-a537-4ea6-a6fd-0134a441c95c None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:59.885145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467e0fe-8d9b-484f-ab80-dac689fb6c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:59.885751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467e0fe-8d9b-484f-ab80-dac689fb6c94 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:59.886034 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467e0fe-8d9b-484f-ab80-dac689fb6c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:59.886311 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467e0fe-8d9b-484f-ab80-dac689fb6c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:59.887058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467e0fe-8d9b-484f-ab80-dac689fb6c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:59.889076 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467e0fe-8d9b-484f-ab80-dac689fb6c94 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:56:59.916980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1240/2460] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:56:59 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:56:59.921080 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd988cb-a06c-4972-8f70-951b0dc832f8 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:56:59.930982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd988cb-a06c-4972-8f70-951b0dc832f8 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:56:59.986678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c07b9-5139-4531-a8bc-85586a1259ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:56:59.987300 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c07b9-5139-4531-a8bc-85586a1259ce admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:56:59.987602 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c07b9-5139-4531-a8bc-85586a1259ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:56:59.987970 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c07b9-5139-4531-a8bc-85586a1259ce admin admin] PATH_INFO: `/v3/users` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:56:59.988609 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c07b9-5139-4531-a8bc-85586a1259ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:56:59.990514 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c07b9-5139-4531-a8bc-85586a1259ce admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:00.011492 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1221/2461] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:56:59 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:57:00.015566 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467e0fe-8d9b-484f-ab80-dac689fb6c94 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:00.026307 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467e0fe-8d9b-484f-ab80-dac689fb6c94 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:00.030909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964359-c6fe-4f7f-8ac9-ea03e566f702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:00.031666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964359-c6fe-4f7f-8ac9-ea03e566f702 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:00.032449 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964359-c6fe-4f7f-8ac9-ea03e566f702 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:00.032720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964359-c6fe-4f7f-8ac9-ea03e566f702 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:00.033349 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3964359-c6fe-4f7f-8ac9-ea03e566f702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:00.034923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3964359-c6fe-4f7f-8ac9-ea03e566f702 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:00.044630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1241/2462] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:57:00.048421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c07b9-5139-4531-a8bc-85586a1259ce admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:00.058263 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c07b9-5139-4531-a8bc-85586a1259ce admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:00.062931 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b85a1-3f01-48e9-8c46-3f679ae42531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:00.063560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b85a1-3f01-48e9-8c46-3f679ae42531 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:00.063847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b85a1-3f01-48e9-8c46-3f679ae42531 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:00.064123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b85a1-3f01-48e9-8c46-3f679ae42531 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:00.064754 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b85a1-3f01-48e9-8c46-3f679ae42531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:00.066332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b85a1-3f01-48e9-8c46-3f679ae42531 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:00.076966 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1222/2463] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:57:00.081362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964359-c6fe-4f7f-8ac9-ea03e566f702 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:00.091147 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964359-c6fe-4f7f-8ac9-ea03e566f702 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:00.096367 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f71e54-d5f9-4c39-8b0f-be8ed2ad5e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:00.097002 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f71e54-d5f9-4c39-8b0f-be8ed2ad5e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:00.097277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f71e54-d5f9-4c39-8b0f-be8ed2ad5e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:00.097547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f71e54-d5f9-4c39-8b0f-be8ed2ad5e8e admin admin] PATH_INFO: `/v3/projects/17fddcf5fd1b46b78a8f45ca61c2f662/users/d0620dffc2c34223ad9d9b151cb1812f/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:00.113082 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f71e54-d5f9-4c39-8b0f-be8ed2ad5e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17fddcf5fd1b46b78a8f45ca61c2f662, user_id=d0620dffc2c34223ad9d9b151cb1812f, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:00.117622 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f71e54-d5f9-4c39-8b0f-be8ed2ad5e8e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:00.130531 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1242/2464] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:57:00 2022] PUT /identity/v3/projects/17fddcf5fd1b46b78a8f45ca61c2f662/users/d0620dffc2c34223ad9d9b151cb1812f/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:57:00.140629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c10e00-ed61-4a56-9a7c-22caf528cd41 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:00.140861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c10e00-ed61-4a56-9a7c-22caf528cd41 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:00.141649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c10e00-ed61-4a56-9a7c-22caf528cd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:00.169339 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-01c10e00-ed61-4a56-9a7c-22caf528cd41 None None] MFA Rules not processed for user `d0620dffc2c34223ad9d9b151cb1812f`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:57:00.170552 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-01c10e00-ed61-4a56-9a7c-22caf528cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:00.238799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1223/2465] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:57:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:57:00.246186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f71e54-d5f9-4c39-8b0f-be8ed2ad5e8e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:00.247951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-75f71e54-d5f9-4c39-8b0f-be8ed2ad5e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:00.270693 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:57:00.307935 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f71e54-d5f9-4c39-8b0f-be8ed2ad5e8e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:00.311542 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80969014-a947-4029-b06d-2d09cf09a3c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:00.312144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80969014-a947-4029-b06d-2d09cf09a3c8 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:00.312421 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80969014-a947-4029-b06d-2d09cf09a3c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:00.312691 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80969014-a947-4029-b06d-2d09cf09a3c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:00.321093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80969014-a947-4029-b06d-2d09cf09a3c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:00.322509 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80969014-a947-4029-b06d-2d09cf09a3c8 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:00.331806 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1243/2466] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:57:00 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:57:05.296388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c10e00-ed61-4a56-9a7c-22caf528cd41 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:05.316682 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:57:05.364286 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c10e00-ed61-4a56-9a7c-22caf528cd41 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:05.368921 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:05.369566 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:05.369848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:05.370121 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] PATH_INFO: `/v3/users/d0620dffc2c34223ad9d9b151cb1812f` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:05.371268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0620dffc2c34223ad9d9b151cb1812f)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:05.373220 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:05.426953 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0620dffc2c34223ad9d9b151cb1812f'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:05.433815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0620dffc2c34223ad9d9b151cb1812f'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:05.434508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0620dffc2c34223ad9d9b151cb1812f'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:05.435122 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0620dffc2c34223ad9d9b151cb1812f'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:05.443435 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0620dffc2c34223ad9d9b151cb1812f'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:05.462268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1224/2467] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:57:05 2022] DELETE /identity/v3/users/d0620dffc2c34223ad9d9b151cb1812f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:57:05.466977 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c84b1-89e1-4949-aa4c-9fe12887c477 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:05.467491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c84b1-89e1-4949-aa4c-9fe12887c477 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:05.467691 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c84b1-89e1-4949-aa4c-9fe12887c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:05.487202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-846c84b1-89e1-4949-aa4c-9fe12887c477 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:57:05.488443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-846c84b1-89e1-4949-aa4c-9fe12887c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:05.547717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1244/2468] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:57:05.560504 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:05.562064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:05.625193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8607c27-74f5-45d2-9100-58ef60036e5c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:05.628847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69712fbc-be79-44cb-9cb0-6db4ba05143f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:05.629456 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69712fbc-be79-44cb-9cb0-6db4ba05143f service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:05.629741 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69712fbc-be79-44cb-9cb0-6db4ba05143f service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:05.630014 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69712fbc-be79-44cb-9cb0-6db4ba05143f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:05.639540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69712fbc-be79-44cb-9cb0-6db4ba05143f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:05.641123 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69712fbc-be79-44cb-9cb0-6db4ba05143f service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:05.650430 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1225/2469] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:57:05.929906 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c84b1-89e1-4949-aa4c-9fe12887c477 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:05.931361 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-846c84b1-89e1-4949-aa4c-9fe12887c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:05.944105 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c84b1-89e1-4949-aa4c-9fe12887c477 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:05.948928 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:05.949565 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:05.950138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:05.950419 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] PATH_INFO: `/v3/projects/17fddcf5fd1b46b78a8f45ca61c2f662` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:05.951619 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17fddcf5fd1b46b78a8f45ca61c2f662)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:05.954044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:06.000750 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17fddcf5fd1b46b78a8f45ca61c2f662', 'request_id': 'req-998602ca-8fa4-4766-9976-3941420abd69'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:06.007690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17fddcf5fd1b46b78a8f45ca61c2f662', 'request_id': 'req-998602ca-8fa4-4766-9976-3941420abd69'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:06.014022 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17fddcf5fd1b46b78a8f45ca61c2f662', 'request_id': 'req-998602ca-8fa4-4766-9976-3941420abd69'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:06.024868 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] The token cache is being invalidate because project 17fddcf5fd1b46b78a8f45ca61c2f662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:57:06.025161 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:06.025817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:06.027521 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1245/2470] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:57:05 2022] DELETE /identity/v3/projects/17fddcf5fd1b46b78a8f45ca61c2f662 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:57:10.200678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69712fbc-be79-44cb-9cb0-6db4ba05143f service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:10.210089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69712fbc-be79-44cb-9cb0-6db4ba05143f service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:10.260166 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:57:10.274317 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d4883-c1c9-4a70-80cd-4806a5de6aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:10.275007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d4883-c1c9-4a70-80cd-4806a5de6aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:10.275306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d4883-c1c9-4a70-80cd-4806a5de6aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:10.275584 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d4883-c1c9-4a70-80cd-4806a5de6aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:10.277749 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-000d4883-c1c9-4a70-80cd-4806a5de6aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:10.359238 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d4883-c1c9-4a70-80cd-4806a5de6aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:10.361294 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d4883-c1c9-4a70-80cd-4806a5de6aa7 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:10.372703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1226/2471] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:57:11.861600 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:11.863186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:11.916499 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:57:11.950917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998602ca-8fa4-4766-9976-3941420abd69 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:11.956947 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4705c-f385-468c-953e-1a710b3f36ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:11.957616 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4705c-f385-468c-953e-1a710b3f36ee service placement] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:11.957901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4705c-f385-468c-953e-1a710b3f36ee service placement] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:11.958212 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4705c-f385-468c-953e-1a710b3f36ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:11.960129 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-10c4705c-f385-468c-953e-1a710b3f36ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:11.974251 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4705c-f385-468c-953e-1a710b3f36ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:11.976060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4705c-f385-468c-953e-1a710b3f36ee service placement] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:11.992267 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1246/2472] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:57:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:57:15.072881 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d4883-c1c9-4a70-80cd-4806a5de6aa7 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:15.074329 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-000d4883-c1c9-4a70-80cd-4806a5de6aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:15.087646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d4883-c1c9-4a70-80cd-4806a5de6aa7 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:15.092982 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:15.093703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:15.093987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:15.094259 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] PATH_INFO: `/v3/users/471702083964469194e11ab184e87c93` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:15.095853 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471702083964469194e11ab184e87c93)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:15.097783 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:15.147097 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471702083964469194e11ab184e87c93'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.153839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471702083964469194e11ab184e87c93'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.154500 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471702083964469194e11ab184e87c93'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.155108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471702083964469194e11ab184e87c93'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.162402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471702083964469194e11ab184e87c93'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.180138 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1227/2473] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:57:15 2022] DELETE /identity/v3/users/471702083964469194e11ab184e87c93 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:57:15.348845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4705c-f385-468c-953e-1a710b3f36ee service placement] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:15.360225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4705c-f385-468c-953e-1a710b3f36ee service placement] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:15.419655 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:15.420303 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:15.420585 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:15.420866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] PATH_INFO: `/v3/projects/92313372ea534925ad95ddd64321b8a1` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:15.422007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92313372ea534925ad95ddd64321b8a1)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:15.423979 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:15.471232 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92313372ea534925ad95ddd64321b8a1', 'request_id': 'req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.478314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92313372ea534925ad95ddd64321b8a1', 'request_id': 'req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.484654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92313372ea534925ad95ddd64321b8a1', 'request_id': 'req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.494966 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] The token cache is being invalidate because project 92313372ea534925ad95ddd64321b8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:57:15.495254 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.495901 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.497369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1247/2474] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:57:15 2022] DELETE /identity/v3/projects/92313372ea534925ad95ddd64321b8a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:57:15.501837 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:15.503254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:15.516374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ad839-4937-42d1-8855-8955c1ccbaa1 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:15.572095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:15.572803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:15.573066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:15.573356 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] PATH_INFO: `/v3/users/734559b4525b416baf1fee51cf68b4cd` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:15.574487 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=734559b4525b416baf1fee51cf68b4cd)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:15.576670 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:15.580733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:57:15.625203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734559b4525b416baf1fee51cf68b4cd'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.632521 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734559b4525b416baf1fee51cf68b4cd'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.633167 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734559b4525b416baf1fee51cf68b4cd'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.633768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734559b4525b416baf1fee51cf68b4cd'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.640828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-331433b6-2bdf-4e2b-b4db-2595c2fd06f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734559b4525b416baf1fee51cf68b4cd'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.657569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1228/2475] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:57:15 2022] DELETE /identity/v3/users/734559b4525b416baf1fee51cf68b4cd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:57:15.826357 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:57:15.827823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:15.841385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8bd3d-4d74-482a-99ca-fd14f86cd4e8 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:57:15.899784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:57:15.900435 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:15.900725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:15.901005 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] PATH_INFO: `/v3/projects/0a3cbb3ec281446187e08cb3d2a0f078` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:15.902186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3cbb3ec281446187e08cb3d2a0f078)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:57:15.904153 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:57:15.913115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:57:15.953533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3cbb3ec281446187e08cb3d2a0f078', 'request_id': 'req-adbb9ff6-50ec-44b3-9341-044e2c39afb3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.962560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3cbb3ec281446187e08cb3d2a0f078', 'request_id': 'req-adbb9ff6-50ec-44b3-9341-044e2c39afb3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.969370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3cbb3ec281446187e08cb3d2a0f078', 'request_id': 'req-adbb9ff6-50ec-44b3-9341-044e2c39afb3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.980227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] The token cache is being invalidate because project 0a3cbb3ec281446187e08cb3d2a0f078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:57:15.980514 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.981156 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:57:15.982634 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1248/2476] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:57:15 2022] DELETE /identity/v3/projects/0a3cbb3ec281446187e08cb3d2a0f078 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:57:25.654096 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:57:25.977251 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:57:39.772865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cf6fb-12e3-41b0-90de-d1c9222b27fd None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:57:39.773385 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cf6fb-12e3-41b0-90de-d1c9222b27fd None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:57:39.773493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cf6fb-12e3-41b0-90de-d1c9222b27fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:57:39.802162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-408cf6fb-12e3-41b0-90de-d1c9222b27fd None None] MFA Rules not processed for user `1d278036e95542b38a80150c6fce26a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:57:39.803391 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-408cf6fb-12e3-41b0-90de-d1c9222b27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:57:39.872659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1229/2477] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:57:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:57:49.870886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=37 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:58:26.907060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:58:26.908749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:58:27.054385 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb9ff6-50ec-44b3-9341-044e2c39afb3 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:58:27.060101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e1e88-7e6c-4fc0-877a-01560cfb167d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:58:27.060717 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e1e88-7e6c-4fc0-877a-01560cfb167d service placement] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:58:27.061117 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e1e88-7e6c-4fc0-877a-01560cfb167d service placement] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:58:27.061397 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e1e88-7e6c-4fc0-877a-01560cfb167d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:58:27.063207 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8b7e1e88-7e6c-4fc0-877a-01560cfb167d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:58:27.075454 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e1e88-7e6c-4fc0-877a-01560cfb167d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:58:27.077865 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e1e88-7e6c-4fc0-877a-01560cfb167d service placement] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:58:27.088843 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1249/2478] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:58:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:58:32.953542 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c70ac-b7df-4fe4-b453-62858ba1603e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:58:32.954119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c70ac-b7df-4fe4-b453-62858ba1603e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:58:32.954119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c70ac-b7df-4fe4-b453-62858ba1603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:58:32.973496 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-418c70ac-b7df-4fe4-b453-62858ba1603e None None] MFA Rules not processed for user `1d278036e95542b38a80150c6fce26a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:58:32.974677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-418c70ac-b7df-4fe4-b453-62858ba1603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:58:32.981832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1230/2479] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:58:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:58:37.083788 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=59 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:58:42.968799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:20.597688 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e1e88-7e6c-4fc0-877a-01560cfb167d service placement] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:20.599070 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-8b7e1e88-7e6c-4fc0-877a-01560cfb167d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:20.675669 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e1e88-7e6c-4fc0-877a-01560cfb167d service placement] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:20.679341 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fecb9-629d-423c-a354-5e116f124373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:20.679940 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fecb9-629d-423c-a354-5e116f124373 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:20.680220 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fecb9-629d-423c-a354-5e116f124373 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:20.680495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fecb9-629d-423c-a354-5e116f124373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:20.682238 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9d0fecb9-629d-423c-a354-5e116f124373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:20.768430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fecb9-629d-423c-a354-5e116f124373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:20.769770 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fecb9-629d-423c-a354-5e116f124373 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:20.789209 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1250/2480] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:59:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:59:22.341797 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c70ac-b7df-4fe4-b453-62858ba1603e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:22.351922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c70ac-b7df-4fe4-b453-62858ba1603e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:22.355469 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17010a13-2a58-459c-9471-11915c31a289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:22.356064 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17010a13-2a58-459c-9471-11915c31a289 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:22.356342 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17010a13-2a58-459c-9471-11915c31a289 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:22.356615 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17010a13-2a58-459c-9471-11915c31a289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:22.358314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-17010a13-2a58-459c-9471-11915c31a289 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:22.373061 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17010a13-2a58-459c-9471-11915c31a289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:22.374475 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17010a13-2a58-459c-9471-11915c31a289 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:22.385179 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1231/2481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:59:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:59:30.786657 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=75 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:32.380394 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=6 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:34.696800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fecb9-629d-423c-a354-5e116f124373 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:34.698221 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-9d0fecb9-629d-423c-a354-5e116f124373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:34.797730 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fecb9-629d-423c-a354-5e116f124373 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:34.802169 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:34.802797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:34.803079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:34.803402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] PATH_INFO: `/v3/users/1d278036e95542b38a80150c6fce26a3` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:34.804528 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d278036e95542b38a80150c6fce26a3)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:34.806443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:34.851915 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d278036e95542b38a80150c6fce26a3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:34.858690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d278036e95542b38a80150c6fce26a3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:34.859427 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d278036e95542b38a80150c6fce26a3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:34.860547 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d278036e95542b38a80150c6fce26a3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:34.867804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-c91681c9-4e9e-4d5d-ac5b-b06b3dc0c98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d278036e95542b38a80150c6fce26a3'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:34.885256 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1251/2482] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:59:34 2022] DELETE /identity/v3/users/1d278036e95542b38a80150c6fce26a3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:59:35.055847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17010a13-2a58-459c-9471-11915c31a289 service cinder] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:35.068254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17010a13-2a58-459c-9471-11915c31a289 service cinder] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:35.128962 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:35.129588 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.129868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.130139 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] PATH_INFO: `/v3/projects/8aa6b631b12c40c69931fe88018ff0a1` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.131239 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa6b631b12c40c69931fe88018ff0a1)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:35.133147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:35.177866 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa6b631b12c40c69931fe88018ff0a1', 'request_id': 'req-9a09d7e3-6529-49d1-aee0-c5ac808e6212'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:35.184131 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa6b631b12c40c69931fe88018ff0a1', 'request_id': 'req-9a09d7e3-6529-49d1-aee0-c5ac808e6212'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:35.192007 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa6b631b12c40c69931fe88018ff0a1', 'request_id': 'req-9a09d7e3-6529-49d1-aee0-c5ac808e6212'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:35.202508 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] The token cache is being invalidate because project 8aa6b631b12c40c69931fe88018ff0a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:59:35.202798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:35.203471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-9a09d7e3-6529-49d1-aee0-c5ac808e6212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:35.204954 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1232/2483] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:59:35 2022] DELETE /identity/v3/projects/8aa6b631b12c40c69931fe88018ff0a1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:59:35.209886 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ac98-8297-4cbc-ad32-9c08277b338d None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.210172 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ac98-8297-4cbc-ad32-9c08277b338d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.210445 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ac98-8297-4cbc-ad32-9c08277b338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.266800 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bb36ac98-8297-4cbc-ad32-9c08277b338d None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:35.268030 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bb36ac98-8297-4cbc-ad32-9c08277b338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:35.280476 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:35.327361 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1252/2484] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:35.334895 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d5618-d1ce-4d8a-bfa4-3ff240fd0ca3 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.335182 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d5618-d1ce-4d8a-bfa4-3ff240fd0ca3 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.335494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d5618-d1ce-4d8a-bfa4-3ff240fd0ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.356590 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-d28d5618-d1ce-4d8a-bfa4-3ff240fd0ca3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:35.357778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-d28d5618-d1ce-4d8a-bfa4-3ff240fd0ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:35.368235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1233/2485] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:35.372407 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ac98-8297-4cbc-ad32-9c08277b338d None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:35.382127 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ac98-8297-4cbc-ad32-9c08277b338d None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:35.386773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa632d-bfd5-425c-95d4-3577ff965a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:35.387418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa632d-bfd5-425c-95d4-3577ff965a83 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.387704 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa632d-bfd5-425c-95d4-3577ff965a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.387977 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa632d-bfd5-425c-95d4-3577ff965a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.388614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa632d-bfd5-425c-95d4-3577ff965a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:59:35.388923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa632d-bfd5-425c-95d4-3577ff965a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:35.390690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa632d-bfd5-425c-95d4-3577ff965a83 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:35.402031 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1253/2486] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:59:35.406861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d5618-d1ce-4d8a-bfa4-3ff240fd0ca3 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:35.415978 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d5618-d1ce-4d8a-bfa4-3ff240fd0ca3 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:35.421077 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e09ae1-fc9f-4ed3-a70f-1510b232f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:35.421710 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e09ae1-fc9f-4ed3-a70f-1510b232f9af admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.422551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e09ae1-fc9f-4ed3-a70f-1510b232f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.422832 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e09ae1-fc9f-4ed3-a70f-1510b232f9af admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.423539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e09ae1-fc9f-4ed3-a70f-1510b232f9af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:35.425485 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e09ae1-fc9f-4ed3-a70f-1510b232f9af admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:35.461848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1234/2487] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:59:35 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:59:35.465987 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa632d-bfd5-425c-95d4-3577ff965a83 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:35.476533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa632d-bfd5-425c-95d4-3577ff965a83 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:35.531141 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d241cb9-0897-4549-ae17-02225cefa01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:35.532265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d241cb9-0897-4549-ae17-02225cefa01b admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.532538 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d241cb9-0897-4549-ae17-02225cefa01b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.532804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d241cb9-0897-4549-ae17-02225cefa01b admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.533413 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d241cb9-0897-4549-ae17-02225cefa01b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:35.535404 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d241cb9-0897-4549-ae17-02225cefa01b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:35.562314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1254/2488] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:59:35 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 04:59:35.563707 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e09ae1-fc9f-4ed3-a70f-1510b232f9af admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:35.574700 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e09ae1-fc9f-4ed3-a70f-1510b232f9af admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:35.580181 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd8193-2706-4d39-95cd-cce421084fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:35.580796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8193-2706-4d39-95cd-cce421084fcb admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.581082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8193-2706-4d39-95cd-cce421084fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.581371 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8193-2706-4d39-95cd-cce421084fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.582004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd8193-2706-4d39-95cd-cce421084fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:35.583657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd8193-2706-4d39-95cd-cce421084fcb admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:35.594216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1235/2489] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:59:35.598281 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d241cb9-0897-4549-ae17-02225cefa01b admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:35.608190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d241cb9-0897-4549-ae17-02225cefa01b admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:35.613437 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0aa51-8a73-48e1-9a50-a3b4408dca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:35.614029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0aa51-8a73-48e1-9a50-a3b4408dca27 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.614314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0aa51-8a73-48e1-9a50-a3b4408dca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.614590 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0aa51-8a73-48e1-9a50-a3b4408dca27 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.615223 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0aa51-8a73-48e1-9a50-a3b4408dca27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:35.616829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0aa51-8a73-48e1-9a50-a3b4408dca27 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:35.627617 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1255/2490] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:59:35.631516 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd8193-2706-4d39-95cd-cce421084fcb admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:35.641818 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd8193-2706-4d39-95cd-cce421084fcb admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:35.646655 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63567a83-95ba-406d-938f-e2ec3ef4b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:35.647332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63567a83-95ba-406d-938f-e2ec3ef4b3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.647618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63567a83-95ba-406d-938f-e2ec3ef4b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.647896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63567a83-95ba-406d-938f-e2ec3ef4b3e8 admin admin] PATH_INFO: `/v3/projects/8dfbd7bc0d94455a8fe63b407c75dd70/users/5ccef4b5e4d24b61858304daeb0baa69/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.662948 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63567a83-95ba-406d-938f-e2ec3ef4b3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfbd7bc0d94455a8fe63b407c75dd70, user_id=5ccef4b5e4d24b61858304daeb0baa69, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:35.665598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63567a83-95ba-406d-938f-e2ec3ef4b3e8 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:35.679015 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1236/2491] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:59:35 2022] PUT /identity/v3/projects/8dfbd7bc0d94455a8fe63b407c75dd70/users/5ccef4b5e4d24b61858304daeb0baa69/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:59:35.690103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0e845-e09a-43aa-835c-8d770253cd3d None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.690399 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0e845-e09a-43aa-835c-8d770253cd3d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.690676 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0e845-e09a-43aa-835c-8d770253cd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.718026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-abc0e845-e09a-43aa-835c-8d770253cd3d None None] MFA Rules not processed for user `5ccef4b5e4d24b61858304daeb0baa69`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:35.719816 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-abc0e845-e09a-43aa-835c-8d770253cd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:35.782850 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1256/2492] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:35.793627 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63567a83-95ba-406d-938f-e2ec3ef4b3e8 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:35.795341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-63567a83-95ba-406d-938f-e2ec3ef4b3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:35.814828 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:35.853785 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63567a83-95ba-406d-938f-e2ec3ef4b3e8 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:35.857427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3de027-f44d-4cc3-94c8-e9ca79513811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:35.858032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3de027-f44d-4cc3-94c8-e9ca79513811 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:35.858316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3de027-f44d-4cc3-94c8-e9ca79513811 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:35.858595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3de027-f44d-4cc3-94c8-e9ca79513811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:35.866847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3de027-f44d-4cc3-94c8-e9ca79513811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:35.868290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3de027-f44d-4cc3-94c8-e9ca79513811 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:35.877019 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1237/2493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:59:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:59:44.209276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0e845-e09a-43aa-835c-8d770253cd3d None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:44.225989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:44.271314 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0e845-e09a-43aa-835c-8d770253cd3d None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:44.275798 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:44.276422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:44.276703 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:44.276975 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] PATH_INFO: `/v3/users/5ccef4b5e4d24b61858304daeb0baa69` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:44.278179 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccef4b5e4d24b61858304daeb0baa69)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:44.280202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:44.325951 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccef4b5e4d24b61858304daeb0baa69'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:44.332651 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccef4b5e4d24b61858304daeb0baa69'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:44.333305 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccef4b5e4d24b61858304daeb0baa69'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:44.333911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccef4b5e4d24b61858304daeb0baa69'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:44.341060 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccef4b5e4d24b61858304daeb0baa69'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:44.358873 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1257/2494] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:59:44 2022] DELETE /identity/v3/users/5ccef4b5e4d24b61858304daeb0baa69 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:59:44.363855 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a758c5-15b8-4ff4-86d0-22472809350a None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:44.364344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a758c5-15b8-4ff4-86d0-22472809350a None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:44.364472 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a758c5-15b8-4ff4-86d0-22472809350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:44.382733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-52a758c5-15b8-4ff4-86d0-22472809350a None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:44.383946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-52a758c5-15b8-4ff4-86d0-22472809350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:44.443066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1238/2495] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:44.452905 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:44.454300 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:44.531624 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90385d9f-f610-4892-a90b-ac5a60681217 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:44.535182 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5925c-4683-4e8f-a8cd-170161f65afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:44.535826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5925c-4683-4e8f-a8cd-170161f65afd service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:44.536108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5925c-4683-4e8f-a8cd-170161f65afd service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:44.536380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5925c-4683-4e8f-a8cd-170161f65afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:44.545375 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5925c-4683-4e8f-a8cd-170161f65afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:44.547402 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5925c-4683-4e8f-a8cd-170161f65afd service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:44.556887 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1258/2496] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:59:44.835154 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a758c5-15b8-4ff4-86d0-22472809350a None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:44.836639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-52a758c5-15b8-4ff4-86d0-22472809350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:44.849465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a758c5-15b8-4ff4-86d0-22472809350a None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:44.854830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:44.855514 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:44.855793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:44.856610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] PATH_INFO: `/v3/projects/8dfbd7bc0d94455a8fe63b407c75dd70` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:44.857207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfbd7bc0d94455a8fe63b407c75dd70)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:44.859341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:44.904889 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfbd7bc0d94455a8fe63b407c75dd70', 'request_id': 'req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:44.911567 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfbd7bc0d94455a8fe63b407c75dd70', 'request_id': 'req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:44.919193 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfbd7bc0d94455a8fe63b407c75dd70', 'request_id': 'req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:44.929205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] The token cache is being invalidate because project 8dfbd7bc0d94455a8fe63b407c75dd70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:59:44.929493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:44.930108 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-10d92fcc-a6b4-4b31-b364-cc754e5c0dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:44.931610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1239/2497] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:59:44 2022] DELETE /identity/v3/projects/8dfbd7bc0d94455a8fe63b407c75dd70 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:59:44.936507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4658de-456d-4dd1-8925-ee17d10dab16 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:44.936797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4658de-456d-4dd1-8925-ee17d10dab16 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:44.937072 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4658de-456d-4dd1-8925-ee17d10dab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:44.957847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2a4658de-456d-4dd1-8925-ee17d10dab16 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:44.959032 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2a4658de-456d-4dd1-8925-ee17d10dab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:44.971309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:45.018957 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1259/2498] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:45.026891 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d3f1c-384f-4ade-8c66-f30c55996b52 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.027213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d3f1c-384f-4ade-8c66-f30c55996b52 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.027526 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d3f1c-384f-4ade-8c66-f30c55996b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.048316 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-166d3f1c-384f-4ade-8c66-f30c55996b52 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:45.049495 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-166d3f1c-384f-4ade-8c66-f30c55996b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:45.057340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1240/2499] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:45.061546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4658de-456d-4dd1-8925-ee17d10dab16 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:45.072000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4658de-456d-4dd1-8925-ee17d10dab16 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:45.076778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca0c28-3c7b-41f6-b35f-afb624ff358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:45.077371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca0c28-3c7b-41f6-b35f-afb624ff358e admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.077650 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca0c28-3c7b-41f6-b35f-afb624ff358e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.077950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca0c28-3c7b-41f6-b35f-afb624ff358e admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.078583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca0c28-3c7b-41f6-b35f-afb624ff358e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:59:45.078884 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca0c28-3c7b-41f6-b35f-afb624ff358e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:45.080558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca0c28-3c7b-41f6-b35f-afb624ff358e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:45.091892 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1260/2500] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:59:45.096411 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d3f1c-384f-4ade-8c66-f30c55996b52 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:45.105644 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d3f1c-384f-4ade-8c66-f30c55996b52 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:45.110874 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca92f4-4d29-4ea4-a1c8-35bd708e790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:45.111498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca92f4-4d29-4ea4-a1c8-35bd708e790a admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.111778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca92f4-4d29-4ea4-a1c8-35bd708e790a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.112116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca92f4-4d29-4ea4-a1c8-35bd708e790a admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.112785 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca92f4-4d29-4ea4-a1c8-35bd708e790a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:45.114675 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca92f4-4d29-4ea4-a1c8-35bd708e790a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:45.141017 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1241/2501] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:59:45 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:59:45.145234 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca0c28-3c7b-41f6-b35f-afb624ff358e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:45.155259 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca0c28-3c7b-41f6-b35f-afb624ff358e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:45.210596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0a1e1-0a4c-4aca-9c96-23729017613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:45.211243 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0a1e1-0a4c-4aca-9c96-23729017613c admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.211524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0a1e1-0a4c-4aca-9c96-23729017613c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.211797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0a1e1-0a4c-4aca-9c96-23729017613c admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.212420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0a1e1-0a4c-4aca-9c96-23729017613c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:45.214443 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0a1e1-0a4c-4aca-9c96-23729017613c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:45.235529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1261/2502] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:59:45 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:59:45.239800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca92f4-4d29-4ea4-a1c8-35bd708e790a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:45.250275 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca92f4-4d29-4ea4-a1c8-35bd708e790a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:45.254938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcfda9-9546-435e-a624-3e5c0e4ea0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:45.255579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcfda9-9546-435e-a624-3e5c0e4ea0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.255868 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcfda9-9546-435e-a624-3e5c0e4ea0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.256156 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcfda9-9546-435e-a624-3e5c0e4ea0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.256791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcfda9-9546-435e-a624-3e5c0e4ea0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:45.258393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcfda9-9546-435e-a624-3e5c0e4ea0b7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:45.268507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1242/2503] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:59:45.272228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0a1e1-0a4c-4aca-9c96-23729017613c admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:45.282422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0a1e1-0a4c-4aca-9c96-23729017613c admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:45.287029 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679e96-a5fc-4276-939a-2c1e709ee043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:45.287642 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679e96-a5fc-4276-939a-2c1e709ee043 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.287923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679e96-a5fc-4276-939a-2c1e709ee043 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.288193 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679e96-a5fc-4276-939a-2c1e709ee043 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.288821 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf679e96-a5fc-4276-939a-2c1e709ee043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:45.290383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf679e96-a5fc-4276-939a-2c1e709ee043 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:45.301315 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1262/2504] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:59:45.305127 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcfda9-9546-435e-a624-3e5c0e4ea0b7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:45.311526 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:45.315524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcfda9-9546-435e-a624-3e5c0e4ea0b7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:45.321995 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afbf1e-858b-445a-9c40-8746d01bb996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:45.322813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afbf1e-858b-445a-9c40-8746d01bb996 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.323261 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afbf1e-858b-445a-9c40-8746d01bb996 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.323610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afbf1e-858b-445a-9c40-8746d01bb996 admin admin] PATH_INFO: `/v3/projects/8c8c4968f09b40c4a757bce3e7e3ac11/users/a9ebf352f82c4bcbb3229ec3e6e2fe04/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.338315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afbf1e-858b-445a-9c40-8746d01bb996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8c4968f09b40c4a757bce3e7e3ac11, user_id=a9ebf352f82c4bcbb3229ec3e6e2fe04, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:45.341179 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afbf1e-858b-445a-9c40-8746d01bb996 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:45.354142 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1243/2505] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:59:45 2022] PUT /identity/v3/projects/8c8c4968f09b40c4a757bce3e7e3ac11/users/a9ebf352f82c4bcbb3229ec3e6e2fe04/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:59:45.366079 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eed67b-0d32-4254-b09e-6442914f2aca None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.366370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eed67b-0d32-4254-b09e-6442914f2aca None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.366654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eed67b-0d32-4254-b09e-6442914f2aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.394358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c8eed67b-0d32-4254-b09e-6442914f2aca None None] MFA Rules not processed for user `a9ebf352f82c4bcbb3229ec3e6e2fe04`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:45.395581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c8eed67b-0d32-4254-b09e-6442914f2aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:45.458832 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1263/2506] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:45.472340 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afbf1e-858b-445a-9c40-8746d01bb996 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:45.474455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b9afbf1e-858b-445a-9c40-8746d01bb996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:45.546822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afbf1e-858b-445a-9c40-8746d01bb996 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:45.552456 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031b0bd-ab38-4dd9-accb-7a95f8244941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e02bef3699b4569986b36cec686931a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:45.552994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b0bd-ab38-4dd9-accb-7a95f8244941 service nova] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.553271 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b0bd-ab38-4dd9-accb-7a95f8244941 service nova] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.553544 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b0bd-ab38-4dd9-accb-7a95f8244941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.561748 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031b0bd-ab38-4dd9-accb-7a95f8244941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:45.563355 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031b0bd-ab38-4dd9-accb-7a95f8244941 service nova] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:45.572527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1244/2507] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:59:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:59:45.781371 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eed67b-0d32-4254-b09e-6442914f2aca None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:45.794157 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:45.843896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eed67b-0d32-4254-b09e-6442914f2aca None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:45.848480 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:45.849107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.849393 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.849674 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] PATH_INFO: `/v3/users/a9ebf352f82c4bcbb3229ec3e6e2fe04` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.850877 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ebf352f82c4bcbb3229ec3e6e2fe04)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:45.852822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:45.897504 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ebf352f82c4bcbb3229ec3e6e2fe04'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:45.904390 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ebf352f82c4bcbb3229ec3e6e2fe04'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:45.905077 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ebf352f82c4bcbb3229ec3e6e2fe04'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:45.905677 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ebf352f82c4bcbb3229ec3e6e2fe04'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:45.912599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ebf352f82c4bcbb3229ec3e6e2fe04'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:45.929603 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1264/2508] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 04:59:45 2022] DELETE /identity/v3/users/a9ebf352f82c4bcbb3229ec3e6e2fe04 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:59:45.934093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d690c-e679-4ba3-b332-1c6754e6fbf5 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:45.934402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d690c-e679-4ba3-b332-1c6754e6fbf5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:45.934683 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d690c-e679-4ba3-b332-1c6754e6fbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:45.954870 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-492d690c-e679-4ba3-b332-1c6754e6fbf5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:45.956196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-492d690c-e679-4ba3-b332-1c6754e6fbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:46.013991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1245/2509] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 04:59:46.024260 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:46.025635 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:46.081878 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd4f72-8b28-41e1-aaee-6355306c6a51 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:46.085529 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdad0f-c913-42e9-9bd2-8fdb78616ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:46.086134 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdad0f-c913-42e9-9bd2-8fdb78616ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.086420 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdad0f-c913-42e9-9bd2-8fdb78616ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.086691 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdad0f-c913-42e9-9bd2-8fdb78616ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.095530 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdad0f-c913-42e9-9bd2-8fdb78616ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:46.096891 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdad0f-c913-42e9-9bd2-8fdb78616ee9 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:46.106328 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1265/2510] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:59:46.371885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d690c-e679-4ba3-b332-1c6754e6fbf5 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:46.373421 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-492d690c-e679-4ba3-b332-1c6754e6fbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:46.386629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d690c-e679-4ba3-b332-1c6754e6fbf5 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:46.391799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:46.392554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.392844 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.393117 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] PATH_INFO: `/v3/projects/8c8c4968f09b40c4a757bce3e7e3ac11` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.394422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8c4968f09b40c4a757bce3e7e3ac11)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:46.396488 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:46.442216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8c4968f09b40c4a757bce3e7e3ac11', 'request_id': 'req-151ed30f-480a-414a-9726-e2d872b98617'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:46.448595 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8c4968f09b40c4a757bce3e7e3ac11', 'request_id': 'req-151ed30f-480a-414a-9726-e2d872b98617'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:46.455718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8c4968f09b40c4a757bce3e7e3ac11', 'request_id': 'req-151ed30f-480a-414a-9726-e2d872b98617'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:46.456922 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:46.468215 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] The token cache is being invalidate because project 8c8c4968f09b40c4a757bce3e7e3ac11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 04:59:46.468566 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:46.469393 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-151ed30f-480a-414a-9726-e2d872b98617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 04:59:46.470901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1246/2511] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 04:59:46 2022] DELETE /identity/v3/projects/8c8c4968f09b40c4a757bce3e7e3ac11 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 04:59:46.475855 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83a69-196b-44c3-889f-7198b693faf0 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.476310 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83a69-196b-44c3-889f-7198b693faf0 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.476411 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83a69-196b-44c3-889f-7198b693faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.496033 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d1f83a69-196b-44c3-889f-7198b693faf0 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:46.497222 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d1f83a69-196b-44c3-889f-7198b693faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:46.527738 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:46.557829 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1266/2512] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:46.566362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902f75-8b45-42ca-ac8c-6f1c30e3d71c None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.566830 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902f75-8b45-42ca-ac8c-6f1c30e3d71c None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.566947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902f75-8b45-42ca-ac8c-6f1c30e3d71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.586791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-16902f75-8b45-42ca-ac8c-6f1c30e3d71c None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:46.588042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-16902f75-8b45-42ca-ac8c-6f1c30e3d71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:46.596647 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1247/2513] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:46.600864 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f83a69-196b-44c3-889f-7198b693faf0 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:46.611010 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f83a69-196b-44c3-889f-7198b693faf0 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:46.615607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dc9c6-fcdc-4a37-baaf-26d275771337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:46.616142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dc9c6-fcdc-4a37-baaf-26d275771337 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.616425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dc9c6-fcdc-4a37-baaf-26d275771337 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.616700 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dc9c6-fcdc-4a37-baaf-26d275771337 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.617338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dc9c6-fcdc-4a37-baaf-26d275771337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 04:59:46.617641 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dc9c6-fcdc-4a37-baaf-26d275771337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:46.619219 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dc9c6-fcdc-4a37-baaf-26d275771337 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:46.630552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1267/2514] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 04:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 04:59:46.634666 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16902f75-8b45-42ca-ac8c-6f1c30e3d71c None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:46.643991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16902f75-8b45-42ca-ac8c-6f1c30e3d71c None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:46.648944 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62503e5-45bb-4d51-a0de-ba4b827882a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:46.649570 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62503e5-45bb-4d51-a0de-ba4b827882a7 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.649823 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62503e5-45bb-4d51-a0de-ba4b827882a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.650132 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62503e5-45bb-4d51-a0de-ba4b827882a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.650765 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62503e5-45bb-4d51-a0de-ba4b827882a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:46.652686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62503e5-45bb-4d51-a0de-ba4b827882a7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:46.681338 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1248/2515] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:59:46 2022] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:59:46.685820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dc9c6-fcdc-4a37-baaf-26d275771337 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:46.695917 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dc9c6-fcdc-4a37-baaf-26d275771337 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:46.753978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c384578-556f-43cd-9b7b-22eb898cf9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:46.754599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c384578-556f-43cd-9b7b-22eb898cf9ba admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.754883 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c384578-556f-43cd-9b7b-22eb898cf9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.755158 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c384578-556f-43cd-9b7b-22eb898cf9ba admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.755826 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c384578-556f-43cd-9b7b-22eb898cf9ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:46.757725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c384578-556f-43cd-9b7b-22eb898cf9ba admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:46.778532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1268/2516] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:59:46 2022] POST /identity/v3/users => generated 278 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:59:46.783197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62503e5-45bb-4d51-a0de-ba4b827882a7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:46.793197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62503e5-45bb-4d51-a0de-ba4b827882a7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:46.798333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e021531-c237-46cb-8fcb-e5d6df4e0262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:46.798927 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021531-c237-46cb-8fcb-e5d6df4e0262 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.799208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021531-c237-46cb-8fcb-e5d6df4e0262 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.799511 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021531-c237-46cb-8fcb-e5d6df4e0262 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.800144 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e021531-c237-46cb-8fcb-e5d6df4e0262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:46.801733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e021531-c237-46cb-8fcb-e5d6df4e0262 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:46.811333 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1249/2517] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:59:46.814950 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c384578-556f-43cd-9b7b-22eb898cf9ba admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:46.824765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c384578-556f-43cd-9b7b-22eb898cf9ba admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:46.829291 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c9b2a-dbe2-4ed4-bd37-2b2e2254689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:46.829870 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c9b2a-dbe2-4ed4-bd37-2b2e2254689c admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.830145 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c9b2a-dbe2-4ed4-bd37-2b2e2254689c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.830412 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c9b2a-dbe2-4ed4-bd37-2b2e2254689c admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.831146 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c9b2a-dbe2-4ed4-bd37-2b2e2254689c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:46.832748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c9b2a-dbe2-4ed4-bd37-2b2e2254689c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:46.842233 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1269/2518] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:59:46.846728 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e021531-c237-46cb-8fcb-e5d6df4e0262 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:46.856540 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e021531-c237-46cb-8fcb-e5d6df4e0262 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:46.861796 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4106e-579f-42ba-9074-5b4359392f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:46.862451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4106e-579f-42ba-9074-5b4359392f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.862719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4106e-579f-42ba-9074-5b4359392f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.862997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4106e-579f-42ba-9074-5b4359392f32 admin admin] PATH_INFO: `/v3/projects/e24f09296a2b4d25a74898e4956a3732/users/f42913b2daaf43e789d589b8f2bc6439/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.877994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4106e-579f-42ba-9074-5b4359392f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24f09296a2b4d25a74898e4956a3732, user_id=f42913b2daaf43e789d589b8f2bc6439, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:46.880646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4106e-579f-42ba-9074-5b4359392f32 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:46.892538 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1250/2519] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:59:46 2022] PUT /identity/v3/projects/e24f09296a2b4d25a74898e4956a3732/users/f42913b2daaf43e789d589b8f2bc6439/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:59:46.902773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af62b5b-9e28-4451-b5d8-b2fe57256f08 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:46.903059 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af62b5b-9e28-4451-b5d8-b2fe57256f08 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:46.903362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af62b5b-9e28-4451-b5d8-b2fe57256f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:46.931574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-3af62b5b-9e28-4451-b5d8-b2fe57256f08 None None] MFA Rules not processed for user `f42913b2daaf43e789d589b8f2bc6439`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:46.932777 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3af62b5b-9e28-4451-b5d8-b2fe57256f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:46.995365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1270/2520] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:46.999822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4106e-579f-42ba-9074-5b4359392f32 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:47.060896 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4106e-579f-42ba-9074-5b4359392f32 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:47.065569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bede35-c640-485a-86ec-abc818fa4827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:47.066169 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bede35-c640-485a-86ec-abc818fa4827 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:47.066455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bede35-c640-485a-86ec-abc818fa4827 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:47.066733 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bede35-c640-485a-86ec-abc818fa4827 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:47.067404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bede35-c640-485a-86ec-abc818fa4827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:47.069289 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bede35-c640-485a-86ec-abc818fa4827 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:47.095934 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1251/2521] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 04:59:46 2022] POST /identity/v3/projects => generated 355 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:59:47.100013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af62b5b-9e28-4451-b5d8-b2fe57256f08 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:47.110549 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af62b5b-9e28-4451-b5d8-b2fe57256f08 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:47.138093 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:47.166513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed8e0b-6d3d-4ef5-8469-90ce7d1c6ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:47.167125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed8e0b-6d3d-4ef5-8469-90ce7d1c6ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:47.167447 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed8e0b-6d3d-4ef5-8469-90ce7d1c6ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:47.167726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed8e0b-6d3d-4ef5-8469-90ce7d1c6ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:47.168338 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed8e0b-6d3d-4ef5-8469-90ce7d1c6ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:47.170231 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed8e0b-6d3d-4ef5-8469-90ce7d1c6ad5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:47.190246 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1271/2522] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 04:59:47 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 04:59:47.194308 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bede35-c640-485a-86ec-abc818fa4827 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:47.205533 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bede35-c640-485a-86ec-abc818fa4827 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:47.210175 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afa15e-0f63-4e06-950f-b5070ef2f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:47.210777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afa15e-0f63-4e06-950f-b5070ef2f1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:47.211062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afa15e-0f63-4e06-950f-b5070ef2f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:47.211377 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afa15e-0f63-4e06-950f-b5070ef2f1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:47.212020 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afa15e-0f63-4e06-950f-b5070ef2f1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:47.213603 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afa15e-0f63-4e06-950f-b5070ef2f1f0 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:47.224621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1252/2523] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 04:59:47.228497 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed8e0b-6d3d-4ef5-8469-90ce7d1c6ad5 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:47.238494 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed8e0b-6d3d-4ef5-8469-90ce7d1c6ad5 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:47.243168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2de836-c26c-4017-b43b-8e1311f5882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:47.243852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2de836-c26c-4017-b43b-8e1311f5882c admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:47.244136 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2de836-c26c-4017-b43b-8e1311f5882c admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:47.244414 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2de836-c26c-4017-b43b-8e1311f5882c admin admin] PATH_INFO: `/v3/projects/5f7731a27d2d430f9da9ea7717288725/users/8847847fee9b44249e71bc0894bbf23d/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:47.258720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2de836-c26c-4017-b43b-8e1311f5882c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7731a27d2d430f9da9ea7717288725, user_id=8847847fee9b44249e71bc0894bbf23d, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:47.261639 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2de836-c26c-4017-b43b-8e1311f5882c admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:47.274555 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1272/2524] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:59:47 2022] PUT /identity/v3/projects/5f7731a27d2d430f9da9ea7717288725/users/8847847fee9b44249e71bc0894bbf23d/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:59:47.278583 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afa15e-0f63-4e06-950f-b5070ef2f1f0 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:47.289044 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afa15e-0f63-4e06-950f-b5070ef2f1f0 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:47.345013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a27c7-5607-4e69-89ea-821b60115b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:47.345618 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a27c7-5607-4e69-89ea-821b60115b38 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:47.345903 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a27c7-5607-4e69-89ea-821b60115b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:47.346180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a27c7-5607-4e69-89ea-821b60115b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:47.346815 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a27c7-5607-4e69-89ea-821b60115b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:47.348423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a27c7-5607-4e69-89ea-821b60115b38 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:47.349622 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:47.359579 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1253/2525] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 04:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 04:59:47.363570 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2de836-c26c-4017-b43b-8e1311f5882c admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:47.373583 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2de836-c26c-4017-b43b-8e1311f5882c admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:47.378599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe2504-538c-4fce-942a-484c2b7c1514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:47.379510 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe2504-538c-4fce-942a-484c2b7c1514 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:47.379790 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe2504-538c-4fce-942a-484c2b7c1514 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:47.380058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe2504-538c-4fce-942a-484c2b7c1514 admin admin] PATH_INFO: `/v3/projects/5f7731a27d2d430f9da9ea7717288725/users/8847847fee9b44249e71bc0894bbf23d/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:47.381935 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe2504-538c-4fce-942a-484c2b7c1514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7731a27d2d430f9da9ea7717288725, user_id=8847847fee9b44249e71bc0894bbf23d, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:47.384584 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe2504-538c-4fce-942a-484c2b7c1514 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:47.395548 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1273/2526] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 04:59:47 2022] PUT /identity/v3/projects/5f7731a27d2d430f9da9ea7717288725/users/8847847fee9b44249e71bc0894bbf23d/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 04:59:47.406648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0780a19-0131-4f47-80f2-29ec50e7c70b None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:47.406945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0780a19-0131-4f47-80f2-29ec50e7c70b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:47.407230 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0780a19-0131-4f47-80f2-29ec50e7c70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:47.434168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-c0780a19-0131-4f47-80f2-29ec50e7c70b None None] MFA Rules not processed for user `8847847fee9b44249e71bc0894bbf23d`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 04:59:47.435427 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-c0780a19-0131-4f47-80f2-29ec50e7c70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:47.502924 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1254/2527] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 04:59:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 04:59:47.514225 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe2504-538c-4fce-942a-484c2b7c1514 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:47.516627 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-fcbe2504-538c-4fce-942a-484c2b7c1514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 04:59:47.573741 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe2504-538c-4fce-942a-484c2b7c1514 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:47.577492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea17c88-3287-4a03-a04e-746916bb354e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:47.578601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea17c88-3287-4a03-a04e-746916bb354e service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:47.578885 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea17c88-3287-4a03-a04e-746916bb354e service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:47.579160 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea17c88-3287-4a03-a04e-746916bb354e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:47.588313 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea17c88-3287-4a03-a04e-746916bb354e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:47.589737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea17c88-3287-4a03-a04e-746916bb354e service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:47.599061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1274/2528] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:59:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:59:47.672730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0780a19-0131-4f47-80f2-29ec50e7c70b None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 04:59:47.682344 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0780a19-0131-4f47-80f2-29ec50e7c70b None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 04:59:47.686004 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc014f-f7e2-4389-8dcf-0095a9924776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 04:59:47.686606 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc014f-f7e2-4389-8dcf-0095a9924776 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 04:59:47.687442 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc014f-f7e2-4389-8dcf-0095a9924776 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 04:59:47.687740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc014f-f7e2-4389-8dcf-0095a9924776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 04:59:47.743981 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc014f-f7e2-4389-8dcf-0095a9924776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 04:59:47.745401 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc014f-f7e2-4389-8dcf-0095a9924776 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 04:59:47.755030 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1255/2529] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 04:59:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 04:59:57.594899 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=56,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 04:59:57.750901 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=64 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:02.471248 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea17c88-3287-4a03-a04e-746916bb354e service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:02.535409 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea17c88-3287-4a03-a04e-746916bb354e service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:02.540126 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:02.540757 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:02.541040 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:02.541318 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] PATH_INFO: `/v3/users/f42913b2daaf43e789d589b8f2bc6439` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:02.542433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42913b2daaf43e789d589b8f2bc6439)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:02.544408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:02.590359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42913b2daaf43e789d589b8f2bc6439'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:02.597601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42913b2daaf43e789d589b8f2bc6439'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:02.598247 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42913b2daaf43e789d589b8f2bc6439'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:02.598838 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42913b2daaf43e789d589b8f2bc6439'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:02.606289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42913b2daaf43e789d589b8f2bc6439'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:02.623007 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1275/2530] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 05:00:02 2022] DELETE /identity/v3/users/f42913b2daaf43e789d589b8f2bc6439 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:02.627510 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c16aa-61f8-4d21-999a-3f41240b86e7 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:02.627994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c16aa-61f8-4d21-999a-3f41240b86e7 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:02.628116 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c16aa-61f8-4d21-999a-3f41240b86e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:02.647055 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5d2c16aa-61f8-4d21-999a-3f41240b86e7 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:02.648287 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5d2c16aa-61f8-4d21-999a-3f41240b86e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:02.708006 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1256/2531] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 05:00:02.717691 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:02.719115 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:02.776265 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e4294-a5c3-434a-9eed-6300e9ed0103 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:02.779765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc078183-de2e-4119-ba55-502b85f89e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:02.780362 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078183-de2e-4119-ba55-502b85f89e92 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:02.780666 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078183-de2e-4119-ba55-502b85f89e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:02.780938 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078183-de2e-4119-ba55-502b85f89e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:02.789706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc078183-de2e-4119-ba55-502b85f89e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:02.791121 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc078183-de2e-4119-ba55-502b85f89e92 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:02.800269 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1276/2532] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:03.064715 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c16aa-61f8-4d21-999a-3f41240b86e7 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:03.066242 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5d2c16aa-61f8-4d21-999a-3f41240b86e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:03.078562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c16aa-61f8-4d21-999a-3f41240b86e7 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:03.083196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:03.083861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:03.084142 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:03.084414 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] PATH_INFO: `/v3/projects/e24f09296a2b4d25a74898e4956a3732` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:03.085691 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24f09296a2b4d25a74898e4956a3732)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:03.087899 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:03.135070 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24f09296a2b4d25a74898e4956a3732', 'request_id': 'req-e84fd438-1795-49c1-bcc4-16b8a586f852'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.141314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24f09296a2b4d25a74898e4956a3732', 'request_id': 'req-e84fd438-1795-49c1-bcc4-16b8a586f852'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.148673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24f09296a2b4d25a74898e4956a3732', 'request_id': 'req-e84fd438-1795-49c1-bcc4-16b8a586f852'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.159066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] The token cache is being invalidate because project e24f09296a2b4d25a74898e4956a3732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 05:00:03.159386 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.160016 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.161513 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1257/2533] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 05:00:03 2022] DELETE /identity/v3/projects/e24f09296a2b4d25a74898e4956a3732 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:03.165630 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc078183-de2e-4119-ba55-502b85f89e92 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:03.176013 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc078183-de2e-4119-ba55-502b85f89e92 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:03.193962 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:03.233904 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:03.234532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:03.234816 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:03.235096 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] PATH_INFO: `/v3/users/8847847fee9b44249e71bc0894bbf23d` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:03.236804 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8847847fee9b44249e71bc0894bbf23d)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:03.238749 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:03.283174 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8847847fee9b44249e71bc0894bbf23d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.289852 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8847847fee9b44249e71bc0894bbf23d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.290507 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8847847fee9b44249e71bc0894bbf23d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.291111 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8847847fee9b44249e71bc0894bbf23d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.297467 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-7858bb3a-1f35-494a-b680-2200fc30aec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8847847fee9b44249e71bc0894bbf23d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.315418 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1277/2534] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 05:00:03 2022] DELETE /identity/v3/users/8847847fee9b44249e71bc0894bbf23d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:03.584844 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:03.586298 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:03.600476 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd438-1795-49c1-bcc4-16b8a586f852 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:03.657154 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:03.657848 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:03.658084 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:03.658360 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] PATH_INFO: `/v3/projects/5f7731a27d2d430f9da9ea7717288725` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:03.659507 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7731a27d2d430f9da9ea7717288725)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:03.661405 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:03.690847 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:03.708822 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7731a27d2d430f9da9ea7717288725', 'request_id': 'req-2d1a512e-b973-4628-9692-f17569617407'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.714939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7731a27d2d430f9da9ea7717288725', 'request_id': 'req-2d1a512e-b973-4628-9692-f17569617407'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.722332 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7731a27d2d430f9da9ea7717288725', 'request_id': 'req-2d1a512e-b973-4628-9692-f17569617407'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.732694 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] The token cache is being invalidate because project 5f7731a27d2d430f9da9ea7717288725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 05:00:03.732967 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.733586 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-2d1a512e-b973-4628-9692-f17569617407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:03.735089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1258/2535] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 05:00:03 2022] DELETE /identity/v3/projects/5f7731a27d2d430f9da9ea7717288725 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:03.739980 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961aca2-5c5a-46bf-bd00-3e6d18902d28 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:03.740481 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961aca2-5c5a-46bf-bd00-3e6d18902d28 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:03.740596 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961aca2-5c5a-46bf-bd00-3e6d18902d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:03.761532 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-d961aca2-5c5a-46bf-bd00-3e6d18902d28 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:03.762766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d961aca2-5c5a-46bf-bd00-3e6d18902d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:03.820302 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1278/2536] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:03.828276 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfed1d-4f7e-4729-9ea0-cee71116a209 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:03.828506 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfed1d-4f7e-4729-9ea0-cee71116a209 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:03.828779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfed1d-4f7e-4729-9ea0-cee71116a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:03.848056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-3ccfed1d-4f7e-4729-9ea0-cee71116a209 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:03.849244 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-3ccfed1d-4f7e-4729-9ea0-cee71116a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:03.857100 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1259/2537] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:03.861599 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961aca2-5c5a-46bf-bd00-3e6d18902d28 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:03.871123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961aca2-5c5a-46bf-bd00-3e6d18902d28 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:03.875859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b30ff-2049-4cc0-9837-2909cb84415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:03.877001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b30ff-2049-4cc0-9837-2909cb84415f admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:03.877286 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b30ff-2049-4cc0-9837-2909cb84415f admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:03.877559 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b30ff-2049-4cc0-9837-2909cb84415f admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:03.878190 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b30ff-2049-4cc0-9837-2909cb84415f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 05:00:03.878492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b30ff-2049-4cc0-9837-2909cb84415f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:03.880114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b30ff-2049-4cc0-9837-2909cb84415f admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:03.891308 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1279/2538] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 05:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 05:00:03.895402 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfed1d-4f7e-4729-9ea0-cee71116a209 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:03.904461 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfed1d-4f7e-4729-9ea0-cee71116a209 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:03.909042 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296f2d-b18b-475c-80a4-2b18bbe394dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:03.909631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296f2d-b18b-475c-80a4-2b18bbe394dc admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:03.909910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296f2d-b18b-475c-80a4-2b18bbe394dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:03.910180 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296f2d-b18b-475c-80a4-2b18bbe394dc admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:03.910808 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3296f2d-b18b-475c-80a4-2b18bbe394dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:03.912695 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3296f2d-b18b-475c-80a4-2b18bbe394dc admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:03.939554 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1260/2539] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 05:00:03 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 05:00:03.943645 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b30ff-2049-4cc0-9837-2909cb84415f admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:03.953618 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b30ff-2049-4cc0-9837-2909cb84415f admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:03.979266 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:04.010377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a06d25-d304-45c0-9bc1-81295b071afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.010988 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a06d25-d304-45c0-9bc1-81295b071afd admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.011271 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a06d25-d304-45c0-9bc1-81295b071afd admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.011576 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a06d25-d304-45c0-9bc1-81295b071afd admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.012205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a06d25-d304-45c0-9bc1-81295b071afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.014114 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a06d25-d304-45c0-9bc1-81295b071afd admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.034263 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1280/2540] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 05:00:03 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:04.038423 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296f2d-b18b-475c-80a4-2b18bbe394dc admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:04.049455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296f2d-b18b-475c-80a4-2b18bbe394dc admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:04.054115 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aee68-4320-4d84-9eba-47419a53b6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.054718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aee68-4320-4d84-9eba-47419a53b6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.055001 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aee68-4320-4d84-9eba-47419a53b6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.055275 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aee68-4320-4d84-9eba-47419a53b6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.055939 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aee68-4320-4d84-9eba-47419a53b6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.057524 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aee68-4320-4d84-9eba-47419a53b6d4 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.067859 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1261/2541] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 05:00:04.071845 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a06d25-d304-45c0-9bc1-81295b071afd admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:04.081654 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a06d25-d304-45c0-9bc1-81295b071afd admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:04.086155 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596bc41-3b4b-40d7-87e3-cbd0007f2d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.086773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596bc41-3b4b-40d7-87e3-cbd0007f2d1e admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.087052 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596bc41-3b4b-40d7-87e3-cbd0007f2d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.087359 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596bc41-3b4b-40d7-87e3-cbd0007f2d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.087991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596bc41-3b4b-40d7-87e3-cbd0007f2d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.089561 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596bc41-3b4b-40d7-87e3-cbd0007f2d1e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.099154 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1281/2542] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:04.103173 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aee68-4320-4d84-9eba-47419a53b6d4 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:04.113314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aee68-4320-4d84-9eba-47419a53b6d4 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:04.117907 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a729ba2-0213-41d0-8ace-b613dd6159ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.118550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729ba2-0213-41d0-8ace-b613dd6159ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.118829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729ba2-0213-41d0-8ace-b613dd6159ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.119102 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a729ba2-0213-41d0-8ace-b613dd6159ff admin admin] PATH_INFO: `/v3/projects/a87fb9d795694ddd814bb787fabfcb26/users/3b04fc1e25b94ee1878c34756b141874/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.134444 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a729ba2-0213-41d0-8ace-b613dd6159ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87fb9d795694ddd814bb787fabfcb26, user_id=3b04fc1e25b94ee1878c34756b141874, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.137158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a729ba2-0213-41d0-8ace-b613dd6159ff admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.151915 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1262/2543] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 05:00:04 2022] PUT /identity/v3/projects/a87fb9d795694ddd814bb787fabfcb26/users/3b04fc1e25b94ee1878c34756b141874/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:04.221495 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12207b-87cb-4c0e-8cde-3bd23551bb5d None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.221779 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12207b-87cb-4c0e-8cde-3bd23551bb5d None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.222101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12207b-87cb-4c0e-8cde-3bd23551bb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.252694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-4b12207b-87cb-4c0e-8cde-3bd23551bb5d None None] MFA Rules not processed for user `3b04fc1e25b94ee1878c34756b141874`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:04.253949 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4b12207b-87cb-4c0e-8cde-3bd23551bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:04.317721 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1282/2544] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:04.322640 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a729ba2-0213-41d0-8ace-b613dd6159ff admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:04.382539 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a729ba2-0213-41d0-8ace-b613dd6159ff admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:04.387084 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ae530-0a13-481d-af3f-b9b4584bacc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.387713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ae530-0a13-481d-af3f-b9b4584bacc9 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.387997 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ae530-0a13-481d-af3f-b9b4584bacc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.388271 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ae530-0a13-481d-af3f-b9b4584bacc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.388917 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ae530-0a13-481d-af3f-b9b4584bacc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.390802 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ae530-0a13-481d-af3f-b9b4584bacc9 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.416654 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1263/2545] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 05:00:04 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:04.420706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12207b-87cb-4c0e-8cde-3bd23551bb5d None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:04.431837 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12207b-87cb-4c0e-8cde-3bd23551bb5d None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:04.487144 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acddb3-9a6d-4b32-a663-461e91a9cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.487805 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acddb3-9a6d-4b32-a663-461e91a9cb2d admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.488081 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acddb3-9a6d-4b32-a663-461e91a9cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.488369 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acddb3-9a6d-4b32-a663-461e91a9cb2d admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.488983 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acddb3-9a6d-4b32-a663-461e91a9cb2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.490896 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acddb3-9a6d-4b32-a663-461e91a9cb2d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.511410 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1283/2546] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 05:00:04 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:04.515315 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ae530-0a13-481d-af3f-b9b4584bacc9 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:04.526203 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ae530-0a13-481d-af3f-b9b4584bacc9 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:04.530861 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102edfa6-c6e9-4972-abdd-a64232b289d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.531503 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102edfa6-c6e9-4972-abdd-a64232b289d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.531791 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102edfa6-c6e9-4972-abdd-a64232b289d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.532069 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102edfa6-c6e9-4972-abdd-a64232b289d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.533330 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102edfa6-c6e9-4972-abdd-a64232b289d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.534947 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102edfa6-c6e9-4972-abdd-a64232b289d4 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.545302 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1264/2547] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:04.549168 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acddb3-9a6d-4b32-a663-461e91a9cb2d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:04.558949 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acddb3-9a6d-4b32-a663-461e91a9cb2d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:04.563859 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3880798-cc61-41d1-9fa9-13bed7f51b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.564546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3880798-cc61-41d1-9fa9-13bed7f51b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.564853 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3880798-cc61-41d1-9fa9-13bed7f51b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.565155 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3880798-cc61-41d1-9fa9-13bed7f51b51 admin admin] PATH_INFO: `/v3/projects/e86caa7cfa04473d958a5947a506b610/users/2d66ffbdaa474671812117594c4c1ac0/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.580701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3880798-cc61-41d1-9fa9-13bed7f51b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86caa7cfa04473d958a5947a506b610, user_id=2d66ffbdaa474671812117594c4c1ac0, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.583628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3880798-cc61-41d1-9fa9-13bed7f51b51 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.596475 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1284/2548] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 05:00:04 2022] PUT /identity/v3/projects/e86caa7cfa04473d958a5947a506b610/users/2d66ffbdaa474671812117594c4c1ac0/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:04.600434 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102edfa6-c6e9-4972-abdd-a64232b289d4 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:04.610509 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102edfa6-c6e9-4972-abdd-a64232b289d4 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:04.629885 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:04.668803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5d02c-197f-47c4-94a2-d099dc90685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.669430 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d02c-197f-47c4-94a2-d099dc90685f admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.669649 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d02c-197f-47c4-94a2-d099dc90685f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.669925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d02c-197f-47c4-94a2-d099dc90685f admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.670561 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5d02c-197f-47c4-94a2-d099dc90685f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.672183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5d02c-197f-47c4-94a2-d099dc90685f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.681729 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1265/2549] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 05:00:04.686026 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3880798-cc61-41d1-9fa9-13bed7f51b51 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:04.691365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:04.698242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3880798-cc61-41d1-9fa9-13bed7f51b51 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:04.702866 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a2eb4-df73-4aff-9c5e-c88d717ee1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.703563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a2eb4-df73-4aff-9c5e-c88d717ee1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.703848 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a2eb4-df73-4aff-9c5e-c88d717ee1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.704125 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a2eb4-df73-4aff-9c5e-c88d717ee1f5 admin admin] PATH_INFO: `/v3/projects/e86caa7cfa04473d958a5947a506b610/users/2d66ffbdaa474671812117594c4c1ac0/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.706633 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a2eb4-df73-4aff-9c5e-c88d717ee1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86caa7cfa04473d958a5947a506b610, user_id=2d66ffbdaa474671812117594c4c1ac0, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.709448 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a2eb4-df73-4aff-9c5e-c88d717ee1f5 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.719405 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1285/2550] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 05:00:04 2022] PUT /identity/v3/projects/e86caa7cfa04473d958a5947a506b610/users/2d66ffbdaa474671812117594c4c1ac0/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:04.729904 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5e996-6eb7-4883-8cac-72bba77bfd7b None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.730197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5e996-6eb7-4883-8cac-72bba77bfd7b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.730481 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5e996-6eb7-4883-8cac-72bba77bfd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.757873 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-bdf5e996-6eb7-4883-8cac-72bba77bfd7b None None] MFA Rules not processed for user `2d66ffbdaa474671812117594c4c1ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:04.759089 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bdf5e996-6eb7-4883-8cac-72bba77bfd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:04.826556 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1266/2551] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:04.838299 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a2eb4-df73-4aff-9c5e-c88d717ee1f5 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:04.840151 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-970a2eb4-df73-4aff-9c5e-c88d717ee1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:04.895793 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a2eb4-df73-4aff-9c5e-c88d717ee1f5 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:04.899598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406996-e8c0-4e78-9542-8a9d67678857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:04.900208 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406996-e8c0-4e78-9542-8a9d67678857 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:04.900512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406996-e8c0-4e78-9542-8a9d67678857 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:04.900784 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406996-e8c0-4e78-9542-8a9d67678857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:04.910200 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406996-e8c0-4e78-9542-8a9d67678857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:04.911658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406996-e8c0-4e78-9542-8a9d67678857 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:04.920882 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1286/2552] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:04.993897 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5e996-6eb7-4883-8cac-72bba77bfd7b None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:05.003528 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5e996-6eb7-4883-8cac-72bba77bfd7b None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:05.007149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff57377-635b-477e-a594-32780e89fd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:05.007778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff57377-635b-477e-a594-32780e89fd4a service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:05.008062 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff57377-635b-477e-a594-32780e89fd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:05.008337 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff57377-635b-477e-a594-32780e89fd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:05.065314 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff57377-635b-477e-a594-32780e89fd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:05.066792 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff57377-635b-477e-a594-32780e89fd4a service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:05.076348 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1267/2553] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:07.775054 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406996-e8c0-4e78-9542-8a9d67678857 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:07.835228 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406996-e8c0-4e78-9542-8a9d67678857 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:07.839720 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:07.840342 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:07.840623 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:07.840895 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] PATH_INFO: `/v3/users/3b04fc1e25b94ee1878c34756b141874` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:07.841993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b04fc1e25b94ee1878c34756b141874)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:07.843930 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:07.888976 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b04fc1e25b94ee1878c34756b141874'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:07.895726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b04fc1e25b94ee1878c34756b141874'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:07.896366 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b04fc1e25b94ee1878c34756b141874'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:07.896974 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b04fc1e25b94ee1878c34756b141874'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:07.903778 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b04fc1e25b94ee1878c34756b141874'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:07.921101 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1287/2554] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 05:00:07 2022] DELETE /identity/v3/users/3b04fc1e25b94ee1878c34756b141874 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:07.925569 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0920429-b799-4b4a-9959-e4b0844583dc None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:07.926043 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0920429-b799-4b4a-9959-e4b0844583dc None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:07.926143 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0920429-b799-4b4a-9959-e4b0844583dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:07.945321 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-b0920429-b799-4b4a-9959-e4b0844583dc None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:07.946779 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b0920429-b799-4b4a-9959-e4b0844583dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:07.985619 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=100 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:08.004789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1268/2555] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:08.014406 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:08.015836 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:08.029442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:08.074428 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04769496-ff07-45df-a914-e43b041eb311 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:08.078086 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc0067-0b96-4afb-8ecf-978490adbd44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:08.078718 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc0067-0b96-4afb-8ecf-978490adbd44 service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:08.078999 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc0067-0b96-4afb-8ecf-978490adbd44 service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:08.079272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc0067-0b96-4afb-8ecf-978490adbd44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:08.088014 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc0067-0b96-4afb-8ecf-978490adbd44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:08.089365 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc0067-0b96-4afb-8ecf-978490adbd44 service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:08.099276 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1288/2556] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:08.608323 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0920429-b799-4b4a-9959-e4b0844583dc None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:08.609747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-b0920429-b799-4b4a-9959-e4b0844583dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:08.621836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0920429-b799-4b4a-9959-e4b0844583dc None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:08.626498 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:08.627197 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:08.627565 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:08.627911 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] PATH_INFO: `/v3/projects/a87fb9d795694ddd814bb787fabfcb26` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:08.629095 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a87fb9d795694ddd814bb787fabfcb26)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:08.631120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:08.677756 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a87fb9d795694ddd814bb787fabfcb26', 'request_id': 'req-5629402d-6f9e-4ae6-97af-8b005d111fd9'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:08.684213 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a87fb9d795694ddd814bb787fabfcb26', 'request_id': 'req-5629402d-6f9e-4ae6-97af-8b005d111fd9'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:08.691506 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a87fb9d795694ddd814bb787fabfcb26', 'request_id': 'req-5629402d-6f9e-4ae6-97af-8b005d111fd9'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:08.702398 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] The token cache is being invalidate because project a87fb9d795694ddd814bb787fabfcb26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 05:00:08.702687 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:08.703390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:08.704862 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1269/2557] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 05:00:08 2022] DELETE /identity/v3/projects/a87fb9d795694ddd814bb787fabfcb26 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:08.708771 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc0067-0b96-4afb-8ecf-978490adbd44 service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:08.718905 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc0067-0b96-4afb-8ecf-978490adbd44 service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:08.776602 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:08.777880 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:08.778036 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:08.778309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] PATH_INFO: `/v3/users/2d66ffbdaa474671812117594c4c1ac0` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:08.779455 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d66ffbdaa474671812117594c4c1ac0)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:08.781380 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:08.827452 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d66ffbdaa474671812117594c4c1ac0'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:08.834180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d66ffbdaa474671812117594c4c1ac0'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:08.834865 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d66ffbdaa474671812117594c4c1ac0'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:08.835505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d66ffbdaa474671812117594c4c1ac0'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:08.842765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3f58ab97-3dc9-42e4-aca6-eb3e41cc6652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d66ffbdaa474671812117594c4c1ac0'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:08.859797 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1289/2558] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 05:00:08 2022] DELETE /identity/v3/users/2d66ffbdaa474671812117594c4c1ac0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:09.128129 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:09.129589 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:09.142799 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629402d-6f9e-4ae6-97af-8b005d111fd9 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:09.199550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:09.200183 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.200465 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.200740 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] PATH_INFO: `/v3/projects/e86caa7cfa04473d958a5947a506b610` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.201846 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86caa7cfa04473d958a5947a506b610)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:09.203788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:09.252131 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86caa7cfa04473d958a5947a506b610', 'request_id': 'req-4fba2d68-89e8-4228-914b-19dc5772315e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:09.258149 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86caa7cfa04473d958a5947a506b610', 'request_id': 'req-4fba2d68-89e8-4228-914b-19dc5772315e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:09.265736 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86caa7cfa04473d958a5947a506b610', 'request_id': 'req-4fba2d68-89e8-4228-914b-19dc5772315e'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:09.271938 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:09.276747 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] The token cache is being invalidate because project e86caa7cfa04473d958a5947a506b610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 05:00:09.277040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:09.277843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-4fba2d68-89e8-4228-914b-19dc5772315e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:09.279829 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1270/2559] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 05:00:09 2022] DELETE /identity/v3/projects/e86caa7cfa04473d958a5947a506b610 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:09.284998 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9adf8-e035-4078-8e40-8ae81679d0f3 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.285479 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9adf8-e035-4078-8e40-8ae81679d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.285764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9adf8-e035-4078-8e40-8ae81679d0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.305858 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-35c9adf8-e035-4078-8e40-8ae81679d0f3 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:09.307085 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-35c9adf8-e035-4078-8e40-8ae81679d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:09.335911 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:09.367512 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1290/2560] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:09.375804 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f4af-445a-4d9b-a8ad-d4c48d54b8f5 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.376207 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f4af-445a-4d9b-a8ad-d4c48d54b8f5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.376553 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f4af-445a-4d9b-a8ad-d4c48d54b8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.396664 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-5b91f4af-445a-4d9b-a8ad-d4c48d54b8f5 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:09.397890 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-5b91f4af-445a-4d9b-a8ad-d4c48d54b8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:09.405819 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1271/2561] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 05:00:09.409972 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9adf8-e035-4078-8e40-8ae81679d0f3 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:09.420408 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9adf8-e035-4078-8e40-8ae81679d0f3 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:09.425066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb89b7-5576-4430-a313-2e19e9426a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:09.425675 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb89b7-5576-4430-a313-2e19e9426a1d admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.425992 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb89b7-5576-4430-a313-2e19e9426a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.426272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb89b7-5576-4430-a313-2e19e9426a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.426916 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb89b7-5576-4430-a313-2e19e9426a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 05:00:09.427227 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb89b7-5576-4430-a313-2e19e9426a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:09.428847 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb89b7-5576-4430-a313-2e19e9426a1d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:09.440961 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1291/2562] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 05:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 05:00:09.445229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91f4af-445a-4d9b-a8ad-d4c48d54b8f5 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:09.454564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91f4af-445a-4d9b-a8ad-d4c48d54b8f5 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:09.459106 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0595ad-005b-4e14-825c-18d736f09927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:09.459721 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0595ad-005b-4e14-825c-18d736f09927 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.460000 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0595ad-005b-4e14-825c-18d736f09927 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.460268 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0595ad-005b-4e14-825c-18d736f09927 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.460894 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0595ad-005b-4e14-825c-18d736f09927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:09.462803 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0595ad-005b-4e14-825c-18d736f09927 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:09.493063 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1272/2563] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 05:00:09 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:09.494812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb89b7-5576-4430-a313-2e19e9426a1d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:09.505291 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb89b7-5576-4430-a313-2e19e9426a1d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:09.560187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a8f97-9def-4812-b7b5-543ac1133ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:09.560801 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8f97-9def-4812-b7b5-543ac1133ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.561087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8f97-9def-4812-b7b5-543ac1133ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.561363 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8f97-9def-4812-b7b5-543ac1133ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.561997 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a8f97-9def-4812-b7b5-543ac1133ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:09.563952 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a8f97-9def-4812-b7b5-543ac1133ea9 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:09.585701 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1292/2564] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 05:00:09 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:09.590267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0595ad-005b-4e14-825c-18d736f09927 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:09.600659 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0595ad-005b-4e14-825c-18d736f09927 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:09.605194 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cecb91-4ad4-42e5-b8bb-ee1d016aa59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:09.606389 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cecb91-4ad4-42e5-b8bb-ee1d016aa59a admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.606670 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cecb91-4ad4-42e5-b8bb-ee1d016aa59a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.606941 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cecb91-4ad4-42e5-b8bb-ee1d016aa59a admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.607631 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cecb91-4ad4-42e5-b8bb-ee1d016aa59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:09.609208 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cecb91-4ad4-42e5-b8bb-ee1d016aa59a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:09.618892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1273/2565] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:09.622876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a8f97-9def-4812-b7b5-543ac1133ea9 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:09.632744 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a8f97-9def-4812-b7b5-543ac1133ea9 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:09.637343 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2651385-a4d8-4486-8a85-05d43de1098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:09.637929 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2651385-a4d8-4486-8a85-05d43de1098b admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.638216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2651385-a4d8-4486-8a85-05d43de1098b admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.638492 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2651385-a4d8-4486-8a85-05d43de1098b admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.639124 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2651385-a4d8-4486-8a85-05d43de1098b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:09.640739 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2651385-a4d8-4486-8a85-05d43de1098b admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:09.651089 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1293/2566] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:09.655430 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cecb91-4ad4-42e5-b8bb-ee1d016aa59a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:09.665053 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cecb91-4ad4-42e5-b8bb-ee1d016aa59a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:09.670246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f91b2f-8587-4efb-9a8c-45141ec3952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:09.670884 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91b2f-8587-4efb-9a8c-45141ec3952b admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.671164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91b2f-8587-4efb-9a8c-45141ec3952b admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.671468 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91b2f-8587-4efb-9a8c-45141ec3952b admin admin] PATH_INFO: `/v3/projects/a1d0bd6ed2514f48b9b3a861cc8da897/users/7c8d799d7c5d4844ab00335c7838666c/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.685550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f91b2f-8587-4efb-9a8c-45141ec3952b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d0bd6ed2514f48b9b3a861cc8da897, user_id=7c8d799d7c5d4844ab00335c7838666c, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:09.688216 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f91b2f-8587-4efb-9a8c-45141ec3952b admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:09.703399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1274/2567] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 05:00:09 2022] PUT /identity/v3/projects/a1d0bd6ed2514f48b9b3a861cc8da897/users/7c8d799d7c5d4844ab00335c7838666c/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:09.715224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aecd75-23db-42c2-8828-a5e06a4a8b11 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.715539 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aecd75-23db-42c2-8828-a5e06a4a8b11 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.715812 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aecd75-23db-42c2-8828-a5e06a4a8b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.743312 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-76aecd75-23db-42c2-8828-a5e06a4a8b11 None None] MFA Rules not processed for user `7c8d799d7c5d4844ab00335c7838666c`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:09.744524 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-76aecd75-23db-42c2-8828-a5e06a4a8b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:09.806905 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1294/2568] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 05:00:09.811455 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f91b2f-8587-4efb-9a8c-45141ec3952b admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:09.872255 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f91b2f-8587-4efb-9a8c-45141ec3952b admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:09.876952 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5ea5-5dd3-4449-a847-1f62b7a69f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:09.877551 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5ea5-5dd3-4449-a847-1f62b7a69f09 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.877839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5ea5-5dd3-4449-a847-1f62b7a69f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.878119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5ea5-5dd3-4449-a847-1f62b7a69f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.878753 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b5ea5-5dd3-4449-a847-1f62b7a69f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:09.880678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b5ea5-5dd3-4449-a847-1f62b7a69f09 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:09.907678 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1275/2569] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 05:00:09 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 05:00:09.911692 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aecd75-23db-42c2-8828-a5e06a4a8b11 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:09.922323 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aecd75-23db-42c2-8828-a5e06a4a8b11 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:09.947707 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:09.979748 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e982f-cc78-47ef-8662-90cfaabea12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:09.980377 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e982f-cc78-47ef-8662-90cfaabea12e admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:09.980647 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e982f-cc78-47ef-8662-90cfaabea12e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:09.980923 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e982f-cc78-47ef-8662-90cfaabea12e admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:09.981560 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e982f-cc78-47ef-8662-90cfaabea12e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:09.983554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e982f-cc78-47ef-8662-90cfaabea12e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:10.004754 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1295/2570] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 05:00:09 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:10.008739 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5ea5-5dd3-4449-a847-1f62b7a69f09 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:10.019434 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5ea5-5dd3-4449-a847-1f62b7a69f09 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:10.024066 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86c0d5-4a68-4e39-b279-5f89787196c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:10.024673 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c0d5-4a68-4e39-b279-5f89787196c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:10.024946 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c0d5-4a68-4e39-b279-5f89787196c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:10.025221 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c0d5-4a68-4e39-b279-5f89787196c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:10.025875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86c0d5-4a68-4e39-b279-5f89787196c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:10.028052 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86c0d5-4a68-4e39-b279-5f89787196c7 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:10.038388 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1276/2571] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:10.042277 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e982f-cc78-47ef-8662-90cfaabea12e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:10.052180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e982f-cc78-47ef-8662-90cfaabea12e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:10.057025 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fa01f-0c00-4d85-8500-699f2a18b4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:10.057663 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fa01f-0c00-4d85-8500-699f2a18b4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:10.057948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fa01f-0c00-4d85-8500-699f2a18b4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:10.058224 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fa01f-0c00-4d85-8500-699f2a18b4f6 admin admin] PATH_INFO: `/v3/projects/54107259f0bc4f20871e5126a7058f95/users/6095d507de684507880cc72228248f7d/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:10.072875 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fa01f-0c00-4d85-8500-699f2a18b4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54107259f0bc4f20871e5126a7058f95, user_id=6095d507de684507880cc72228248f7d, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:10.076214 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fa01f-0c00-4d85-8500-699f2a18b4f6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:10.088558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1296/2572] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 05:00:10 2022] PUT /identity/v3/projects/54107259f0bc4f20871e5126a7058f95/users/6095d507de684507880cc72228248f7d/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:10.093147 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86c0d5-4a68-4e39-b279-5f89787196c7 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:10.103145 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86c0d5-4a68-4e39-b279-5f89787196c7 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:10.158610 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd054955-2729-45c1-a4db-27b7070af21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:10.159252 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd054955-2729-45c1-a4db-27b7070af21f admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:10.159509 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd054955-2729-45c1-a4db-27b7070af21f admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:10.159789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd054955-2729-45c1-a4db-27b7070af21f admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:10.160422 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd054955-2729-45c1-a4db-27b7070af21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:10.162013 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd054955-2729-45c1-a4db-27b7070af21f admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:10.172274 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1277/2573] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:10.176612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fa01f-0c00-4d85-8500-699f2a18b4f6 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:10.187335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fa01f-0c00-4d85-8500-699f2a18b4f6 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:10.192044 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958bc0f-b1fd-4924-b2bd-b8c107bc5186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:10.192687 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958bc0f-b1fd-4924-b2bd-b8c107bc5186 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:10.192967 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958bc0f-b1fd-4924-b2bd-b8c107bc5186 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:10.193240 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958bc0f-b1fd-4924-b2bd-b8c107bc5186 admin admin] PATH_INFO: `/v3/projects/54107259f0bc4f20871e5126a7058f95/users/6095d507de684507880cc72228248f7d/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:10.195135 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958bc0f-b1fd-4924-b2bd-b8c107bc5186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54107259f0bc4f20871e5126a7058f95, user_id=6095d507de684507880cc72228248f7d, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:10.198049 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958bc0f-b1fd-4924-b2bd-b8c107bc5186 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:10.208061 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1297/2574] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 05:00:10 2022] PUT /identity/v3/projects/54107259f0bc4f20871e5126a7058f95/users/6095d507de684507880cc72228248f7d/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:10.218162 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1f16-8467-4f6d-80f1-44a09555d7d5 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:10.218478 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1f16-8467-4f6d-80f1-44a09555d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:10.218784 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1f16-8467-4f6d-80f1-44a09555d7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:10.226836 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:10.249760 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-af8d1f16-8467-4f6d-80f1-44a09555d7d5 None None] MFA Rules not processed for user `6095d507de684507880cc72228248f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:10.250987 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-af8d1f16-8467-4f6d-80f1-44a09555d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:10.316964 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1278/2575] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 05:00:10.327925 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958bc0f-b1fd-4924-b2bd-b8c107bc5186 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:10.329714 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-4958bc0f-b1fd-4924-b2bd-b8c107bc5186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:10.389301 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958bc0f-b1fd-4924-b2bd-b8c107bc5186 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:10.393354 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113cf8e-07ab-40eb-bd98-762e94d318c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:10.394107 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113cf8e-07ab-40eb-bd98-762e94d318c2 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:10.394383 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113cf8e-07ab-40eb-bd98-762e94d318c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:10.394706 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113cf8e-07ab-40eb-bd98-762e94d318c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:10.404614 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113cf8e-07ab-40eb-bd98-762e94d318c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:10.406094 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113cf8e-07ab-40eb-bd98-762e94d318c2 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:10.415319 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1298/2576] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:10.460860 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d1f16-8467-4f6d-80f1-44a09555d7d5 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:10.462235 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-af8d1f16-8467-4f6d-80f1-44a09555d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:10.475036 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d1f16-8467-4f6d-80f1-44a09555d7d5 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:10.478719 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fde9a-a71d-4d5a-bc73-99fd87dc411d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:10.479390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fde9a-a71d-4d5a-bc73-99fd87dc411d service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:10.479677 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fde9a-a71d-4d5a-bc73-99fd87dc411d service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:10.479959 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fde9a-a71d-4d5a-bc73-99fd87dc411d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:10.535527 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fde9a-a71d-4d5a-bc73-99fd87dc411d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:10.536951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fde9a-a71d-4d5a-bc73-99fd87dc411d service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:10.546246 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1279/2577] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:13.794578 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113cf8e-07ab-40eb-bd98-762e94d318c2 service cinder] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:13.854533 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113cf8e-07ab-40eb-bd98-762e94d318c2 service cinder] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:13.858993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:13.859640 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:13.859919 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:13.860191 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] PATH_INFO: `/v3/users/7c8d799d7c5d4844ab00335c7838666c` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:13.861289 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8d799d7c5d4844ab00335c7838666c)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:13.863206 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:13.890278 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:13.910104 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8d799d7c5d4844ab00335c7838666c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:13.916774 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8d799d7c5d4844ab00335c7838666c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:13.917422 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8d799d7c5d4844ab00335c7838666c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:13.918047 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8d799d7c5d4844ab00335c7838666c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:13.924993 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8d799d7c5d4844ab00335c7838666c'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:13.941490 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1299/2578] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 05:00:13 2022] DELETE /identity/v3/users/7c8d799d7c5d4844ab00335c7838666c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:13.946187 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d253d09-8cac-4d3b-9f20-7d91224df3b4 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:13.946656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d253d09-8cac-4d3b-9f20-7d91224df3b4 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:13.946772 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d253d09-8cac-4d3b-9f20-7d91224df3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:13.966304 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-1d253d09-8cac-4d3b-9f20-7d91224df3b4 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:13.967522 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1d253d09-8cac-4d3b-9f20-7d91224df3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:14.024118 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1280/2579] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 05:00:14.034317 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:14.035727 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:14.091075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f0e5-bfee-4aab-9aa1-b5efb914ed7d admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:14.094695 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a177f28-24a8-4fb0-83e3-1d14427eb08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:14.095306 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a177f28-24a8-4fb0-83e3-1d14427eb08f service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:14.095601 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a177f28-24a8-4fb0-83e3-1d14427eb08f service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:14.095869 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a177f28-24a8-4fb0-83e3-1d14427eb08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:14.104725 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a177f28-24a8-4fb0-83e3-1d14427eb08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:14.106109 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a177f28-24a8-4fb0-83e3-1d14427eb08f service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:14.115192 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1300/2580] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:14.371658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d253d09-8cac-4d3b-9f20-7d91224df3b4 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:14.373098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-1d253d09-8cac-4d3b-9f20-7d91224df3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:14.385902 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d253d09-8cac-4d3b-9f20-7d91224df3b4 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:14.391703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:14.392494 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:14.392777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:14.393160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] PATH_INFO: `/v3/projects/a1d0bd6ed2514f48b9b3a861cc8da897` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:14.394781 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d0bd6ed2514f48b9b3a861cc8da897)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:14.397272 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:14.423369 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:14.446362 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d0bd6ed2514f48b9b3a861cc8da897', 'request_id': 'req-034620bc-8dde-40e4-b9ab-facbb1b19533'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:14.452547 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d0bd6ed2514f48b9b3a861cc8da897', 'request_id': 'req-034620bc-8dde-40e4-b9ab-facbb1b19533'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:14.459576 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d0bd6ed2514f48b9b3a861cc8da897', 'request_id': 'req-034620bc-8dde-40e4-b9ab-facbb1b19533'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:14.470114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] The token cache is being invalidate because project a1d0bd6ed2514f48b9b3a861cc8da897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 05:00:14.470404 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:14.471032 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:14.472564 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1281/2581] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 05:00:14 2022] DELETE /identity/v3/projects/a1d0bd6ed2514f48b9b3a861cc8da897 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:14.476865 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a177f28-24a8-4fb0-83e3-1d14427eb08f service neutron] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:14.487001 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a177f28-24a8-4fb0-83e3-1d14427eb08f service neutron] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:14.541130 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:14.541751 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:14.542030 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:14.542304 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] PATH_INFO: `/v3/users/6095d507de684507880cc72228248f7d` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:14.543939 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6095d507de684507880cc72228248f7d)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:14.545837 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:14.596000 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6095d507de684507880cc72228248f7d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:14.597171 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:14.606200 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6095d507de684507880cc72228248f7d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:14.606912 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6095d507de684507880cc72228248f7d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:14.607552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6095d507de684507880cc72228248f7d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:14.614862 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-826700c1-8ee1-4d6f-915a-3e03ddef39dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6095d507de684507880cc72228248f7d'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:14.632358 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1301/2582] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 05:00:14 2022] DELETE /identity/v3/users/6095d507de684507880cc72228248f7d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:14.903368 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:14.904800 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:14.918231 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034620bc-8dde-40e4-b9ab-facbb1b19533 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:14.975462 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:14.976111 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:14.976373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:14.976653 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] PATH_INFO: `/v3/projects/54107259f0bc4f20871e5126a7058f95` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:14.977775 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=54107259f0bc4f20871e5126a7058f95)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:14.979725 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:15.025635 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54107259f0bc4f20871e5126a7058f95', 'request_id': 'req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:15.031751 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54107259f0bc4f20871e5126a7058f95', 'request_id': 'req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:15.038951 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54107259f0bc4f20871e5126a7058f95', 'request_id': 'req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:15.049179 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] The token cache is being invalidate because project 54107259f0bc4f20871e5126a7058f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 05:00:15.049471 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:15.050113 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-967ccad3-ebbc-4f0b-9b42-de79ab5b3aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:15.051731 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1282/2583] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 05:00:14 2022] DELETE /identity/v3/projects/54107259f0bc4f20871e5126a7058f95 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:15.056543 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91ee0-ec59-4440-bdb2-decfb9875c5e None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.057017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91ee0-ec59-4440-bdb2-decfb9875c5e None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.057119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91ee0-ec59-4440-bdb2-decfb9875c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.077621 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-2df91ee0-ec59-4440-bdb2-decfb9875c5e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:15.078820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-2df91ee0-ec59-4440-bdb2-decfb9875c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:15.137425 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1302/2584] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:15.146560 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772708b-7ef5-4b18-96c9-92742c59c23e None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.146793 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772708b-7ef5-4b18-96c9-92742c59c23e None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.147079 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772708b-7ef5-4b18-96c9-92742c59c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.166373 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-9772708b-7ef5-4b18-96c9-92742c59c23e None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:15.169341 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-9772708b-7ef5-4b18-96c9-92742c59c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:15.176133 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1283/2585] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:15.180558 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df91ee0-ec59-4440-bdb2-decfb9875c5e None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:15.190914 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df91ee0-ec59-4440-bdb2-decfb9875c5e None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:15.195969 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f7e18-9691-41fa-b3e6-838d2288ac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:15.196571 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7e18-9691-41fa-b3e6-838d2288ac3a admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.196880 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7e18-9691-41fa-b3e6-838d2288ac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.197180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7e18-9691-41fa-b3e6-838d2288ac3a admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.197819 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f7e18-9691-41fa-b3e6-838d2288ac3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 05:00:15.198119 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f7e18-9691-41fa-b3e6-838d2288ac3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:15.199823 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f7e18-9691-41fa-b3e6-838d2288ac3a admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:15.211123 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1303/2586] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 05:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 05:00:15.215451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772708b-7ef5-4b18-96c9-92742c59c23e None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:15.224581 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772708b-7ef5-4b18-96c9-92742c59c23e None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:15.229254 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f86ed2-9d46-48e6-bb2d-a092b70e854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:15.229843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f86ed2-9d46-48e6-bb2d-a092b70e854c admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.230632 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f86ed2-9d46-48e6-bb2d-a092b70e854c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.230910 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f86ed2-9d46-48e6-bb2d-a092b70e854c admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.231578 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f86ed2-9d46-48e6-bb2d-a092b70e854c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:15.233451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f86ed2-9d46-48e6-bb2d-a092b70e854c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:15.260172 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1284/2587] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 05:00:15 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:15.264187 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f7e18-9691-41fa-b3e6-838d2288ac3a admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:15.273822 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f7e18-9691-41fa-b3e6-838d2288ac3a admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:15.328765 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd2c9e-a2dc-4b3d-a379-8fb8bdf8c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:15.329375 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2c9e-a2dc-4b3d-a379-8fb8bdf8c343 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.329658 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2c9e-a2dc-4b3d-a379-8fb8bdf8c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.329931 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2c9e-a2dc-4b3d-a379-8fb8bdf8c343 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.330553 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd2c9e-a2dc-4b3d-a379-8fb8bdf8c343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:15.332550 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd2c9e-a2dc-4b3d-a379-8fb8bdf8c343 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:15.352556 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1304/2588] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 05:00:15 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:15.357105 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f86ed2-9d46-48e6-bb2d-a092b70e854c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:15.367320 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f86ed2-9d46-48e6-bb2d-a092b70e854c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:15.372469 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c4bf0-abe2-4a3f-b80c-c918b74d0a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:15.373098 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c4bf0-abe2-4a3f-b80c-c918b74d0a7c admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.373381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c4bf0-abe2-4a3f-b80c-c918b74d0a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.373658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c4bf0-abe2-4a3f-b80c-c918b74d0a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.374290 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c4bf0-abe2-4a3f-b80c-c918b74d0a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:15.375927 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c4bf0-abe2-4a3f-b80c-c918b74d0a7c admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:15.385690 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1285/2589] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:15.389505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd2c9e-a2dc-4b3d-a379-8fb8bdf8c343 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:15.400909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd2c9e-a2dc-4b3d-a379-8fb8bdf8c343 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:15.405608 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f40b9f-7483-4cc8-b978-36817229eed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:15.406202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40b9f-7483-4cc8-b978-36817229eed6 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.406486 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40b9f-7483-4cc8-b978-36817229eed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.406763 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f40b9f-7483-4cc8-b978-36817229eed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.407466 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f40b9f-7483-4cc8-b978-36817229eed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:15.409058 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f40b9f-7483-4cc8-b978-36817229eed6 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:15.420087 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1305/2590] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:15.424057 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c4bf0-abe2-4a3f-b80c-c918b74d0a7c admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:15.429158 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:15.436229 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c4bf0-abe2-4a3f-b80c-c918b74d0a7c admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:15.441912 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dab0b-d9fc-4aa6-a59d-fa190532f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:15.442616 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dab0b-d9fc-4aa6-a59d-fa190532f16a admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.442892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dab0b-d9fc-4aa6-a59d-fa190532f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.443164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dab0b-d9fc-4aa6-a59d-fa190532f16a admin admin] PATH_INFO: `/v3/projects/b28ee234a81b448ebd03b658ec956459/users/1d781eb1974e41e58751d1bbeebb09d6/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.457813 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dab0b-d9fc-4aa6-a59d-fa190532f16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28ee234a81b448ebd03b658ec956459, user_id=1d781eb1974e41e58751d1bbeebb09d6, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:15.460716 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dab0b-d9fc-4aa6-a59d-fa190532f16a admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:15.472541 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1286/2591] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 05:00:15 2022] PUT /identity/v3/projects/b28ee234a81b448ebd03b658ec956459/users/1d781eb1974e41e58751d1bbeebb09d6/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:15.483442 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbccd2c-4ba2-44b3-a228-a96fd3a14e21 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.483813 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbccd2c-4ba2-44b3-a228-a96fd3a14e21 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.484097 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbccd2c-4ba2-44b3-a228-a96fd3a14e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.512152 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-bcbccd2c-4ba2-44b3-a228-a96fd3a14e21 None None] MFA Rules not processed for user `1d781eb1974e41e58751d1bbeebb09d6`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:15.513370 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-bcbccd2c-4ba2-44b3-a228-a96fd3a14e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:15.531534 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:15.578607 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1306/2592] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:15.590082 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dab0b-d9fc-4aa6-a59d-fa190532f16a admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:15.591856 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-120dab0b-d9fc-4aa6-a59d-fa190532f16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:15.646713 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dab0b-d9fc-4aa6-a59d-fa190532f16a admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:15.650432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2871cd7-86dd-4bb9-885c-e8770ca11df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:15.651077 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2871cd7-86dd-4bb9-885c-e8770ca11df7 service cinder] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.651328 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2871cd7-86dd-4bb9-885c-e8770ca11df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.651605 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2871cd7-86dd-4bb9-885c-e8770ca11df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.660176 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2871cd7-86dd-4bb9-885c-e8770ca11df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:15.661578 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2871cd7-86dd-4bb9-885c-e8770ca11df7 service cinder] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:15.670669 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1287/2593] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:15.691767 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbccd2c-4ba2-44b3-a228-a96fd3a14e21 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:15.753987 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbccd2c-4ba2-44b3-a228-a96fd3a14e21 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:15.758554 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:15.759180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.759491 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.759766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] PATH_INFO: `/v3/users/1d781eb1974e41e58751d1bbeebb09d6` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.760876 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d781eb1974e41e58751d1bbeebb09d6)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:15.762900 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:15.807552 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d781eb1974e41e58751d1bbeebb09d6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:15.814215 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d781eb1974e41e58751d1bbeebb09d6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:15.814890 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d781eb1974e41e58751d1bbeebb09d6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:15.815545 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d781eb1974e41e58751d1bbeebb09d6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:15.823216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d781eb1974e41e58751d1bbeebb09d6'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:15.840469 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1307/2594] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 05:00:15 2022] DELETE /identity/v3/users/1d781eb1974e41e58751d1bbeebb09d6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:15.844888 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9377d-c380-4d77-bd5b-abddef26ce5f None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.845266 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9377d-c380-4d77-bd5b-abddef26ce5f None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.845550 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9377d-c380-4d77-bd5b-abddef26ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:15.865821 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0da9377d-c380-4d77-bd5b-abddef26ce5f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:15.867002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0da9377d-c380-4d77-bd5b-abddef26ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:15.924453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1288/2595] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 05:00:15.933773 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:15.935173 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:15.978582 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:15.993581 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f487c10-4e45-4a4f-947d-e54675443df0 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:15.997298 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3752f0f-0137-4627-959b-01f4d6e8d43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:15.997905 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3752f0f-0137-4627-959b-01f4d6e8d43d service neutron] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:15.998188 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3752f0f-0137-4627-959b-01f4d6e8d43d service neutron] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:15.998463 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3752f0f-0137-4627-959b-01f4d6e8d43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.007293 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3752f0f-0137-4627-959b-01f4d6e8d43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:16.008726 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3752f0f-0137-4627-959b-01f4d6e8d43d service neutron] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:16.018569 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1308/2596] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:16.284002 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9377d-c380-4d77-bd5b-abddef26ce5f None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:16.285443 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0da9377d-c380-4d77-bd5b-abddef26ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:16.297620 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9377d-c380-4d77-bd5b-abddef26ce5f None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:16.302269 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:16.302991 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.303376 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.303648 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] PATH_INFO: `/v3/projects/b28ee234a81b448ebd03b658ec956459` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.304768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28ee234a81b448ebd03b658ec956459)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:16.306656 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:16.352381 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28ee234a81b448ebd03b658ec956459', 'request_id': 'req-14c62ee6-f8e6-401d-9bb0-be4a7613e402'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:16.358634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28ee234a81b448ebd03b658ec956459', 'request_id': 'req-14c62ee6-f8e6-401d-9bb0-be4a7613e402'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:16.365994 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28ee234a81b448ebd03b658ec956459', 'request_id': 'req-14c62ee6-f8e6-401d-9bb0-be4a7613e402'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:16.376879 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] The token cache is being invalidate because project b28ee234a81b448ebd03b658ec956459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 05:00:16.377186 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:16.377798 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-14c62ee6-f8e6-401d-9bb0-be4a7613e402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:16.379276 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1289/2597] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 05:00:16 2022] DELETE /identity/v3/projects/b28ee234a81b448ebd03b658ec956459 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:16.384176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43ceec-4112-4d72-82fc-ad483927580f None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.384635 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43ceec-4112-4d72-82fc-ad483927580f None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.384733 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43ceec-4112-4d72-82fc-ad483927580f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.405166 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-6c43ceec-4112-4d72-82fc-ad483927580f None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:16.406360 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-6c43ceec-4112-4d72-82fc-ad483927580f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:16.464430 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1309/2598] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:16.472119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f7c3-5a69-4dd8-ba44-f54c444c5ac7 None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.472419 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f7c3-5a69-4dd8-ba44-f54c444c5ac7 None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.472703 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f7c3-5a69-4dd8-ba44-f54c444c5ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.481451 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:16.493164 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-0cc8f7c3-5a69-4dd8-ba44-f54c444c5ac7 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:16.494374 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-0cc8f7c3-5a69-4dd8-ba44-f54c444c5ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:16.502770 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1290/2599] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:16.506978 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43ceec-4112-4d72-82fc-ad483927580f None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:16.517083 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43ceec-4112-4d72-82fc-ad483927580f None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:16.521801 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be673ae0-eee3-485c-998f-161ca50a4217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:16.522433 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be673ae0-eee3-485c-998f-161ca50a4217 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.522715 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be673ae0-eee3-485c-998f-161ca50a4217 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.523023 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be673ae0-eee3-485c-998f-161ca50a4217 admin admin] PATH_INFO: `/v3/domains` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.523705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be673ae0-eee3-485c-998f-161ca50a4217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93090) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 05:00:16.524012 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be673ae0-eee3-485c-998f-161ca50a4217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:16.525628 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be673ae0-eee3-485c-998f-161ca50a4217 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:16.537320 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1310/2600] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Oct 12 05:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 05:00:16.541711 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8f7c3-5a69-4dd8-ba44-f54c444c5ac7 None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:16.550780 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8f7c3-5a69-4dd8-ba44-f54c444c5ac7 None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:16.555480 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6d91-fee1-4272-b2c4-d8505d734869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:16.556081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6d91-fee1-4272-b2c4-d8505d734869 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.556368 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6d91-fee1-4272-b2c4-d8505d734869 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.556646 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6d91-fee1-4272-b2c4-d8505d734869 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.557276 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf6d91-fee1-4272-b2c4-d8505d734869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:16.559750 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf6d91-fee1-4272-b2c4-d8505d734869 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:16.587324 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1291/2601] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 05:00:16 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:16.591503 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be673ae0-eee3-485c-998f-161ca50a4217 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:16.601309 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be673ae0-eee3-485c-998f-161ca50a4217 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:16.655417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86321e17-ac03-4799-be09-b7ec32ff29a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:16.656011 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86321e17-ac03-4799-be09-b7ec32ff29a9 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.656290 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86321e17-ac03-4799-be09-b7ec32ff29a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.656565 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86321e17-ac03-4799-be09-b7ec32ff29a9 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.657180 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86321e17-ac03-4799-be09-b7ec32ff29a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:16.659066 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86321e17-ac03-4799-be09-b7ec32ff29a9 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:16.680546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1311/2602] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 05:00:16 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:16.685493 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6d91-fee1-4272-b2c4-d8505d734869 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:16.696137 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6d91-fee1-4272-b2c4-d8505d734869 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:16.700817 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa93a3-97b2-4f75-8c12-6939d3489e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:16.701416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa93a3-97b2-4f75-8c12-6939d3489e57 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.701702 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa93a3-97b2-4f75-8c12-6939d3489e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.701983 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa93a3-97b2-4f75-8c12-6939d3489e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.702621 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa93a3-97b2-4f75-8c12-6939d3489e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:16.704252 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa93a3-97b2-4f75-8c12-6939d3489e57 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:16.713925 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1292/2603] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:16.717830 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86321e17-ac03-4799-be09-b7ec32ff29a9 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:16.727592 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86321e17-ac03-4799-be09-b7ec32ff29a9 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:16.732714 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4dfc4-8786-48fe-bda0-ccba51099d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:16.733296 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4dfc4-8786-48fe-bda0-ccba51099d48 admin admin] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.733577 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4dfc4-8786-48fe-bda0-ccba51099d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.733851 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4dfc4-8786-48fe-bda0-ccba51099d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.734482 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4dfc4-8786-48fe-bda0-ccba51099d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:16.736096 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4dfc4-8786-48fe-bda0-ccba51099d48 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:16.746905 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1312/2604] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:16.750789 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa93a3-97b2-4f75-8c12-6939d3489e57 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:16.760638 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa93a3-97b2-4f75-8c12-6939d3489e57 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:16.765986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dce272-95ff-479d-a5bf-a76051672d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:16.766657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce272-95ff-479d-a5bf-a76051672d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.766945 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce272-95ff-479d-a5bf-a76051672d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.767226 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce272-95ff-479d-a5bf-a76051672d3e admin admin] PATH_INFO: `/v3/projects/648de9d789784ce88490dc735529bd87/users/1facef259d9b4d348901a610d00b9322/roles/d39456c8f0144ddeba3555d56fc50e3a` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.783065 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dce272-95ff-479d-a5bf-a76051672d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=648de9d789784ce88490dc735529bd87, user_id=1facef259d9b4d348901a610d00b9322, role_id=d39456c8f0144ddeba3555d56fc50e3a)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:16.786081 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dce272-95ff-479d-a5bf-a76051672d3e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:16.798839 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1293/2605] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 05:00:16 2022] PUT /identity/v3/projects/648de9d789784ce88490dc735529bd87/users/1facef259d9b4d348901a610d00b9322/roles/d39456c8f0144ddeba3555d56fc50e3a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 05:00:16.810626 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3499d-5dbe-4532-a769-e613867135c2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.810913 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3499d-5dbe-4532-a769-e613867135c2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.811186 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3499d-5dbe-4532-a769-e613867135c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.838170 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-c9d3499d-5dbe-4532-a769-e613867135c2 None None] MFA Rules not processed for user `1facef259d9b4d348901a610d00b9322`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:16.839396 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-c9d3499d-5dbe-4532-a769-e613867135c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:16.876612 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:16.903361 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1313/2606] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:16.907865 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dce272-95ff-479d-a5bf-a76051672d3e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:16.968955 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dce272-95ff-479d-a5bf-a76051672d3e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:16.973492 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6504b2b-7de3-4536-922f-5980451768c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:16.974086 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6504b2b-7de3-4536-922f-5980451768c3 admin admin] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:16.974364 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6504b2b-7de3-4536-922f-5980451768c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:16.974634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6504b2b-7de3-4536-922f-5980451768c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:16.975267 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6504b2b-7de3-4536-922f-5980451768c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:16.977205 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6504b2b-7de3-4536-922f-5980451768c3 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:17.003453 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1294/2607] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Oct 12 05:00:16 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 05:00:17.007572 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3499d-5dbe-4532-a769-e613867135c2 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:17.018177 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3499d-5dbe-4532-a769-e613867135c2 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:17.072598 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bf3cf-daa1-4bc0-aefb-e5c3323b4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:17.073202 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf3cf-daa1-4bc0-aefb-e5c3323b4ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:17.073484 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf3cf-daa1-4bc0-aefb-e5c3323b4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:17.073761 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf3cf-daa1-4bc0-aefb-e5c3323b4ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:17.074386 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bf3cf-daa1-4bc0-aefb-e5c3323b4ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:17.076335 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bf3cf-daa1-4bc0-aefb-e5c3323b4ab1 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:17.097820 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1314/2608] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Oct 12 05:00:17 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 05:00:17.101718 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6504b2b-7de3-4536-922f-5980451768c3 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:17.112454 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6504b2b-7de3-4536-922f-5980451768c3 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:17.117021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c33d6e-807f-4ed0-9eb8-8555dda583e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:17.117608 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c33d6e-807f-4ed0-9eb8-8555dda583e0 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:17.117892 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c33d6e-807f-4ed0-9eb8-8555dda583e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:17.118165 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c33d6e-807f-4ed0-9eb8-8555dda583e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:17.118788 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c33d6e-807f-4ed0-9eb8-8555dda583e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:17.120399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c33d6e-807f-4ed0-9eb8-8555dda583e0 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:17.130598 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1295/2609] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:17.134698 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bf3cf-daa1-4bc0-aefb-e5c3323b4ab1 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:17.144523 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bf3cf-daa1-4bc0-aefb-e5c3323b4ab1 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:17.149176 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3c1ea-0803-45d7-9970-5fce07b55c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:17.149817 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3c1ea-0803-45d7-9970-5fce07b55c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:17.150103 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3c1ea-0803-45d7-9970-5fce07b55c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:17.150382 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3c1ea-0803-45d7-9970-5fce07b55c6e admin admin] PATH_INFO: `/v3/projects/2fb126e685ba4fccbd7500f4affad33e/users/4d99a2b903d143a9a59d6d7b40965706/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:17.165189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3c1ea-0803-45d7-9970-5fce07b55c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb126e685ba4fccbd7500f4affad33e, user_id=4d99a2b903d143a9a59d6d7b40965706, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:17.168423 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3c1ea-0803-45d7-9970-5fce07b55c6e admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:17.180705 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1315/2610] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 05:00:17 2022] PUT /identity/v3/projects/2fb126e685ba4fccbd7500f4affad33e/users/4d99a2b903d143a9a59d6d7b40965706/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:17.184536 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c33d6e-807f-4ed0-9eb8-8555dda583e0 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:17.194477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c33d6e-807f-4ed0-9eb8-8555dda583e0 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:17.250026 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90792c26-48c3-45c3-9e8b-df09f145b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:17.250562 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792c26-48c3-45c3-9e8b-df09f145b0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:17.250845 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792c26-48c3-45c3-9e8b-df09f145b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:17.251120 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90792c26-48c3-45c3-9e8b-df09f145b0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:17.251842 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90792c26-48c3-45c3-9e8b-df09f145b0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:17.253432 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90792c26-48c3-45c3-9e8b-df09f145b0e4 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:17.263224 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1296/2611] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Oct 12 05:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 05:00:17.267401 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3c1ea-0803-45d7-9970-5fce07b55c6e admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:17.278080 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3c1ea-0803-45d7-9970-5fce07b55c6e admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:17.282766 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e50dc-1306-4f61-95d7-cec99beb0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:17.283451 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e50dc-1306-4f61-95d7-cec99beb0130 admin admin] REQUEST_METHOD: `PUT` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:17.283737 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e50dc-1306-4f61-95d7-cec99beb0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:17.284017 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e50dc-1306-4f61-95d7-cec99beb0130 admin admin] PATH_INFO: `/v3/projects/2fb126e685ba4fccbd7500f4affad33e/users/4d99a2b903d143a9a59d6d7b40965706/roles/3d2307e73cdb4f6291f9735ac9359702` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:17.285933 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e50dc-1306-4f61-95d7-cec99beb0130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb126e685ba4fccbd7500f4affad33e, user_id=4d99a2b903d143a9a59d6d7b40965706, role_id=3d2307e73cdb4f6291f9735ac9359702)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:17.288605 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e50dc-1306-4f61-95d7-cec99beb0130 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:17.299272 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1316/2612] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Oct 12 05:00:17 2022] PUT /identity/v3/projects/2fb126e685ba4fccbd7500f4affad33e/users/4d99a2b903d143a9a59d6d7b40965706/roles/3d2307e73cdb4f6291f9735ac9359702 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:17.309196 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb74557-0d30-420f-a6d6-7467d1af709b None None] REQUEST_METHOD: `POST` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:17.309658 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb74557-0d30-420f-a6d6-7467d1af709b None None] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:17.309778 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb74557-0d30-420f-a6d6-7467d1af709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:17.329639 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:17.338358 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.auth.core [None req-bfb74557-0d30-420f-a6d6-7467d1af709b None None] MFA Rules not processed for user `4d99a2b903d143a9a59d6d7b40965706`. Rule list: `[]` (Enabled: `True`). {{(pid=93091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:17.340152 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-bfb74557-0d30-420f-a6d6-7467d1af709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:17.409090 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1297/2613] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 05:00:17.420237 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e50dc-1306-4f61-95d7-cec99beb0130 admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:17.421991 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ab9e50dc-1306-4f61-95d7-cec99beb0130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:17.480150 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e50dc-1306-4f61-95d7-cec99beb0130 admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:17.483818 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745eccf-1ea0-491a-83cc-b54daffac3a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '946db23ba1fe47999ae12f8380f4c48a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:17.484417 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745eccf-1ea0-491a-83cc-b54daffac3a7 service cinder] REQUEST_METHOD: `GET` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:17.484694 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745eccf-1ea0-491a-83cc-b54daffac3a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:17.484968 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745eccf-1ea0-491a-83cc-b54daffac3a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:17.528488 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:17.542242 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745eccf-1ea0-491a-83cc-b54daffac3a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:17.543769 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745eccf-1ea0-491a-83cc-b54daffac3a7 service cinder] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:17.552546 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1317/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:20.078306 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb74557-0d30-420f-a6d6-7467d1af709b None None] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:20.138657 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb74557-0d30-420f-a6d6-7467d1af709b None None] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:20.143462 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:20.144088 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:20.144367 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:20.144642 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] PATH_INFO: `/v3/users/1facef259d9b4d348901a610d00b9322` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:20.145777 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1facef259d9b4d348901a610d00b9322)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:20.147696 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:20.195119 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1facef259d9b4d348901a610d00b9322'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.202253 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1facef259d9b4d348901a610d00b9322'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.202891 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1facef259d9b4d348901a610d00b9322'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.203514 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1facef259d9b4d348901a610d00b9322'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.210520 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1facef259d9b4d348901a610d00b9322'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.228416 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1298/2615] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 05:00:20 2022] DELETE /identity/v3/users/1facef259d9b4d348901a610d00b9322 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:20.233392 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce870a96-e3ad-47c3-9436-c5a091b936a2 None None] REQUEST_METHOD: `POST` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:20.233867 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce870a96-e3ad-47c3-9436-c5a091b936a2 None None] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:20.233964 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce870a96-e3ad-47c3-9436-c5a091b936a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:20.252690 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.auth.core [None req-ce870a96-e3ad-47c3-9436-c5a091b936a2 None None] MFA Rules not processed for user `a3723e7b0b694f7a91766c751c166949`. Rule list: `[]` (Enabled: `True`). {{(pid=93090) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 05:00:20.253894 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ce870a96-e3ad-47c3-9436-c5a091b936a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:20.311142 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1318/2616] 10.222.0.18 () {58 vars in 958 bytes} [Wed Oct 12 05:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 05:00:20.321040 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:20.322477 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:20.341399 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:20.381390 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8db0fd-b760-42cb-9287-9a01b5aeb64e admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:20.385076 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ce7d2-c1f3-4ae2-8efb-6645225628e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc59d3cc1fbc4d4382bffd8ae93075e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:20.385686 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce7d2-c1f3-4ae2-8efb-6645225628e6 service neutron] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:20.385965 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce7d2-c1f3-4ae2-8efb-6645225628e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:20.386252 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce7d2-c1f3-4ae2-8efb-6645225628e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:20.396629 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ce7d2-c1f3-4ae2-8efb-6645225628e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:20.398093 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ce7d2-c1f3-4ae2-8efb-6645225628e6 service neutron] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:20.408343 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1299/2617] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:00:20.672511 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce870a96-e3ad-47c3-9436-c5a091b936a2 None None] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:20.673948 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-ce870a96-e3ad-47c3-9436-c5a091b936a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:20.687909 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce870a96-e3ad-47c3-9436-c5a091b936a2 None None] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:20.692958 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:20.693764 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:20.694138 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:20.694505 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] PATH_INFO: `/v3/projects/648de9d789784ce88490dc735529bd87` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:20.695963 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] RBAC: Authorizing `identity:delete_project(project_id=648de9d789784ce88490dc735529bd87)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:20.698331 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:20.745075 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648de9d789784ce88490dc735529bd87', 'request_id': 'req-601ab8b3-d68e-4523-a986-1e721775befe'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.752670 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648de9d789784ce88490dc735529bd87', 'request_id': 'req-601ab8b3-d68e-4523-a986-1e721775befe'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.758945 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648de9d789784ce88490dc735529bd87', 'request_id': 'req-601ab8b3-d68e-4523-a986-1e721775befe'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.771095 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] The token cache is being invalidate because project 648de9d789784ce88490dc735529bd87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 05:00:20.771426 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.772050 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.773513 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1319/2618] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 05:00:20 2022] DELETE /identity/v3/projects/648de9d789784ce88490dc735529bd87 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 05:00:20.777634 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ce7d2-c1f3-4ae2-8efb-6645225628e6 service neutron] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:20.787114 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ce7d2-c1f3-4ae2-8efb-6645225628e6 service neutron] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:20.843573 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:20.844204 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:20.844490 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:20.844768 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] PATH_INFO: `/v3/users/4d99a2b903d143a9a59d6d7b40965706` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:20.845886 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d99a2b903d143a9a59d6d7b40965706)` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:20.847843 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:20.893350 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d99a2b903d143a9a59d6d7b40965706'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.900395 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d99a2b903d143a9a59d6d7b40965706'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.901059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d99a2b903d143a9a59d6d7b40965706'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.901679 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d99a2b903d143a9a59d6d7b40965706'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.908986 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.notifications [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d99a2b903d143a9a59d6d7b40965706'} {{(pid=93091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:20.926160 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1300/2619] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Oct 12 05:00:20 2022] DELETE /identity/v3/users/4d99a2b903d143a9a59d6d7b40965706 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:21.191461 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] Authenticating user token {{(pid=93090) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:00:21.193099 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.fernet_utils [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93090) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:00:21.206772 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab8b3-d68e-4523-a986-1e721775befe admin admin] Validating token access rules against request {{(pid=93090) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:00:21.262989 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3723e7b0b694f7a91766c751c166949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aeb630740ccb4099b311e8a52a3b6b07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93090) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:00:21.263671 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:00:21.263921 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] SCRIPT_NAME: `/identity` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:00:21.264195 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] PATH_INFO: `/v3/projects/2fb126e685ba4fccbd7500f4affad33e` {{(pid=93090) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:00:21.265322 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb126e685ba4fccbd7500f4affad33e)` {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:00:21.267216 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] RBAC: Authorization granted {{(pid=93090) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:00:21.277574 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:21.314108 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb126e685ba4fccbd7500f4affad33e', 'request_id': 'req-3a198ae9-4e4b-4d0d-9b09-d98170727776'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:21.321205 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb126e685ba4fccbd7500f4affad33e', 'request_id': 'req-3a198ae9-4e4b-4d0d-9b09-d98170727776'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:21.327372 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb126e685ba4fccbd7500f4affad33e', 'request_id': 'req-3a198ae9-4e4b-4d0d-9b09-d98170727776'} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:21.337275 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] The token cache is being invalidate because project 2fb126e685ba4fccbd7500f4affad33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93090) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 05:00:21.337563 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:21.338189 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG keystone.notifications [None req-3a198ae9-4e4b-4d0d-9b09-d98170727776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93090) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 05:00:21.339684 dv-cinder-861032-1-smb devstack@keystone.service[93090]: [pid: 93090|app: 0|req: 1320/2620] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Oct 12 05:00:21 2022] DELETE /identity/v3/projects/2fb126e685ba4fccbd7500f4affad33e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 05:00:30.922769 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:00:31.334339 dv-cinder-861032-1-smb devstack@keystone.service[93090]: DEBUG dbcounter [-] [93090] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 05:03:29.730372 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] Authenticating user token {{(pid=93091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 05:03:29.731875 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:03:29.800318 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9c68b-be7d-402e-b3bb-16bc0b6bdc55 admin admin] Validating token access rules against request {{(pid=93091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 05:03:29.858056 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e95b8-68e0-4e8e-8f8c-d32af2c0f19a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332a44161d204223983ed2aa3aef9317', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ec61ba796824f7daa146d9ae5f03228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 05:03:29.858730 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e95b8-68e0-4e8e-8f8c-d32af2c0f19a service placement] REQUEST_METHOD: `GET` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 05:03:29.859021 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e95b8-68e0-4e8e-8f8c-d32af2c0f19a service placement] SCRIPT_NAME: `/identity` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 05:03:29.859345 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e95b8-68e0-4e8e-8f8c-d32af2c0f19a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 05:03:29.861059 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.fernet_utils [None req-733e95b8-68e0-4e8e-8f8c-d32af2c0f19a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 05:03:29.871893 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e95b8-68e0-4e8e-8f8c-d32af2c0f19a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 05:03:29.873436 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e95b8-68e0-4e8e-8f8c-d32af2c0f19a service placement] RBAC: Authorization granted {{(pid=93091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 05:03:29.883168 dv-cinder-861032-1-smb devstack@keystone.service[93091]: [pid: 93091|app: 0|req: 1301/2621] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Oct 12 05:03:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 05:03:39.879024 dv-cinder-861032-1-smb devstack@keystone.service[93091]: DEBUG dbcounter [-] [93091] Writing DB stats keystone:SELECT=58 {{(pid=93091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}